1. Executive Summary 


The Board of Directors of the Santa Clara Valley Water District (District) commissioned 
Red Oak Consulting, a division of Malcolm Pirnie, Inc. (Red Oak) to perform a 
comprehensive performance audit of the District focusing on governance, leadership, 
management, financial practices, and operational effectiveness and efficiency. Following 
Generally Accepted Government Auditing Standards (GAGAS), and incorporating criteria 
and key aspects of the Baldrige National Quality Program (Baldrige), Red Oak conducted 
the audit between June 2005 and August 2006. Red Oak performed the audit in a 
structured fashion, beginning with the Board of Directors and working through the 
District’s organization, ultimately auditing throughout the agency and delivering seven 
interim audit memoranda in the process. Key auditing tools and methods included 
document review, individual and group interviews, questionnaires, fact-checking, 
validation meetings, review of Red Oak work products by key District staff, and 
presentations to the Board of Directors’ Audit Committee, which consisted of both Board 
members and community/stakeholder representatives. Red Oak led the audit with a core 
project management team and engaged subject-matter experts as appropriate to focus on 
selected areas of the audit and to provide quality assurance of Red Oak’s audit criteria and 
deliverables to the District. This is Red Oak’s final summary report, representing 
completion of this performance audit for the District. 

Red Oak recognizes the District is operating in difficult times. The current catch-phrase 
“doing more with less” is true for many public agencies, but applies acutely to the 
District—for example, it is engaging in activities such as additional environmental 
stewardship while the State of California has rescinded more than $50 million in property- 
tax funding. The District has always placed an emphasis on the high quality of the services 
it provides, and its adoption of a Baldrige-based quality management approach—putting 
the District at the forefront of public agencies in the application of Baldrige—and the 
undertaking of this performance audit underscore that emphasis. 

As expected, Red Oak identified both “strengths” and “opportunities for improvement” 
throughout the District during this audit. These findings are all presented in this summary 
report and its appendices, and Red Oak has compiled and scored each recommendation to 
facilitate the District’s implementation process. The main body of this report focuses on 
significant findings that cross organizational lines at the District and over-arching issues 
that Red Oak found to be manifested in multiple areas of the District. 

Two common themes emerged during Red Oak’s audit across the organization. The 
District is gener all y very strong in individual professional disciplines throughout the 
agency. However, the District generally lacks the well-developed organization-wide 
cohesion in planning and execution that would set it apart from its peers and that is a 
trademark of the top-performing public and private-sector organizations to which the 
District has asked to be compared through its strong emphasis on Baldrige. The District is 
quite strong in department-level strategic business planning, but at the time of our audit 
fieldwork, was lacking a true agency-wide strategic business plan. Red Oak found a 
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Section 7 

Baldrige Category 1 - Leadership 


The CEO has engaged in dialogue with the Board over his interpretations of the Board’s 
policies, but the results of these efforts are not fully reflected in the sets of Board 
governance policies made available to Red Oak during this audit (July 2005; May 2006). 

The CEO’s interpretations of the Ends Policies as currently documented also vary 
significantly in specificity and some essentially defer interpretation to the Board (e.g., 
3.1.1., on the topic of watershed protection/restoration). As a result, executive managers 
who are charged with leading the District’s functional areas do not have a consistent 
understanding of the CEO’s interpretations or how otherwise to achieve the Board’s 
policies, although they are very clear on the policy governance concept and the Board’s 
policies themselves as noted earlier in this section. Red Oak understands that the District, 
since the time of the audit fieldwork, has been working to address this issue, for example, 
through the development of a new “CEO Work Plan” and set of organization-wide 
performance measures. 

The CEO’s interpretations of the Ends Policies have also not been translated into business 
plans and/or measurable performance metrics consistently across the organization or in a 
consistent manner. Inconsistent format and state of plan development are found across the 
District regarding (1) the level of clarity on the CEO’s interpretation of the Ends Policies 
and (2) format and development of plans linking the Ends Policies and their CEO 
interpretations to the day-to-day operations of the District. 

Red Oak believes that the District’s historically active, but somewhat scattered strategic 
planning efforts, which are discussed further in the following report section addressing 
strategic planning, evidence insufficient District-wide priority on thorough CEO-level 
interpretation of the Board’s policies and translating those interpretations into District 
planning and operations. In many cases, operating groups and staff feel they have no 
system or guidance to prioritize project implementation and/or funding relative to District¬ 
wide goals, because such a system is not fully “deployed” (in Baldrige terminology). 

Addressing this area would support the District’s pursuit of Baldrige criteria, specifically 
Item 1.1 of “Senior Leadership.” The District could align itself with the Baldrige scoring 
model by furthering its leadership’s ability to communicate across the organization and 
create an organization-wide focus on improving performance, achieving District 
objectives, and attaining the District’s vision. 


7.1.4. Board Committees and Interaction with Staff 

The Carver Policy Governance Model is designed to allow staff to fully engage in daily 
core activities of the District while focusing Board involvement on top-level policy and 
planning efforts. The lack of Board policies for some key operational areas of the District, 
combined with somewhat inconsistent CEO interpretations of Board Policies for staff-level 
activities, represents an opportunity for improvement in the District’s application of policy 
governance. This is further evidenced by the Board’s use of committees and the Board 
Member Request system as discussed in the following paragraphs. 
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Section 8 

Baldrige Category 2 - Strategic Planning 


As noted in earlier sections, this and other audit findings throughout this report reflect the 
condition of the District at the time of Red Oak’s audit fieldwork. This is one of the areas 
where the District has already begun to address Red Oak’s audit recommendation. 
Specifically, between the time of the audit fieldwork and the preparation of this report, the 
District reported to Red Oak that it had begun reconciliation of its existing individual 
strategic planning efforts and development of a “CEO Work Plan” in response to this 
recommendation. 


8.2. Department-Level Business Plans 


Watershed Operations, Capital Program Services, the Information Management Division 
(within Administration ) and the Water Utility Enterprise, among others, have developed 
their own business plans. Administration is in the process of developing its business plan. 
Although there are typically references in these business plans to specific Board Ends 
Policies, and Capital Program Services supports a 5-year rolling Capital Improvement 
Program plan for capital projects, there is not a District-wide strategic plan that lays out 
which programs, projects, or Board/management initiatives the District will (and will not) 
take on in both the near-term and long-term. Consequently, there is not currently a formal 
mechanism in place to make sure that each business plan rolls up to the District’s vision 
and mission, as well as complements the other business plans. Please see the final 
paragraph of Section 8.1 above regarding District efforts underway to address this at the 
time of this writing. 


8.3. Budgeting 


The District undertakes a rigorous annual budgeting process, as discussed in more detail in 
Red Oak’s audit memorandum addressing financial functions at the District (Appendix D). 
Though the budgeting process should be reflective of the annual prioritization process, 
Red Oak’s audit activities indicate that it does not consistently serve during the year as a 
common, agency-wide “governor” on what the District is and isn’t able to undertake 
during a given budget period. This has significant implications with respect to the 
District’s ability to manage the scope of its activities, its costs, its staffing levels, and its 
focus on its key service areas. 

In addition, auditees indicated with high consistency throughout this audit that the 
budgeting process and level of dialogue among the Board, CEO, and managers/staff do not 
sufficiently or clearly lay out the District’s priorities for staff. Activity-based or results- 
based budgeting will direct costs to District priorities that require those costs to be 
incurred. A key challenge appears to be that initiatives such as the pursuit of a new 
management model or certification (e.g., ISO) are often rolled out despite not being 
included in the applicable year’s budget. 
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Section 9 

Baldrige Category 3 - Customer and Market Focus 


Watershed Operations has taken a number of important steps with respect to the services 
it provides to its customers and its customer coordination, including strong community 
outreach through the Water Resources Protection Collaborative, evaluation and 
incorporation of Clean, Safe Creeks and Natural Flood Protection Program project area 
customer satisfaction rankings and annual review by the Independent Monitoring 
Committee, stakeholder involvement to develop Stewardship Plans, and participation in 
the Santa Clara Valley Urban Runoff Pollution Prevention Program (SCVURPPP). Similar 
to the Water Utility Enterprise, Watershed Operations performs much of its customer 
outreach independent of other operating groups and of the District’s Office of 
Communication. The District also has an opportunity to consistently recognize other local 
entities such as Santa Clara County or the City of San Jose as integral to its delivery of 
services to the community. 

While the District’s Capital Program Services group has recently made a Capital Program 
Services-wide effort to distinctly define their ultimate customers as “the public” and both 
internal District groups (Water Utility Enterprise, Watershed Operations) and external 
stakeholders (local organizations and cities) involved in project delivery as “partners,” 
there is an opportunity for improvement with respect to District-wide coordination. 
Specifically, the customer group definitions Capital Program Services has adopted are not 
consistent throughout the District; for example, while Capital Program Services refers to 
Water Utility Enterprise as a “partner,” Water Utility Enterprise considers itself a 
’’customer” of Capital Program Services. While largely semantic, this inconsistency in 
terminology can lead to confusion in internal District documents, such as capital project 
“Project Plans,” and among District teams and organizational units in working with 
external agencies and coordinating with each other. An agency-wide understanding of 
terminology of internal and external entities would help to foster organizational cohesion 
and shared purpose. 

The District may wish to refer to the 2006 Baldrige program for common definitions of 
“customer,” “stakeholder,” “partner,” and other terms that it should consider adopting 
for (1) consistency across the District and (2) alignment with Baldrige terminology. The 
District reported to Red Oak since the time of the audit fieldwork that it is already 
underway with reconciliation of “customer” and similar definitions and relationships 
across the organization. 

The District’s Administration department makes an effort to understand and respond to 
internal customer needs. Furthermore, Red Oak has found that Administration has 
multiple vehicles in place to maintain and improve the services they provide based on 
customer feedback (e.g., Clerk of the Board survey, Treatment of Staff survey, Human 
Resources Benefits Administration Unit Customer Satisfaction survey, Information 
Management Division Help Desk). These provide an excellent foundation on which to 
build more systematic, measurable customer feedback measures to demonstrate improved 
service over time. Key administrative areas such as training, reprographics, and reception 
are particularly amenable for structured customer feedback measurement and process 
improvement over time. Any customer feedback processes must be conducted within the 
context of the organization’s objectives and policies and understood fully by the 
participants; otherwise, they can devolve into open-ended “complaint” forums or vehicles 
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Management Division. This may not pose an immediate problem, but Red 
Oak agrees with District staff that, in the long run, this will likely prove to be 
inefficient and hamper somewhat the District’s ability to fully implement 
some of the recommendations (e.g., regarding system integration) 
presented elsewhere in this memorandum. 

District View: 

New initiative needed. 

Disagree: Condition 

The PeopleSoft budget module was procured, but was not implemented 
due to the pending decision on the future strategic direction regarding 
budget preparation/monitoring, etc. 

Admin 33 

OFI 

Delegate real estate 
authority 

Audit Recommendation: The District should grant the Real Estate Unit 
Manager the authority to make property acquisition settlement agreements 
within a reasonable amount above the appraised amount. Above this 
amount, more senior members of the leadership team should participate in 
the negotiation. The criteria can be developed from other agencies, such 
as Caltrans. This will increase the efficiency of capital project delivery and 
reduce unnecessary work for both real estate and legal personnel. 

The District should explore other areas of delegation that would improve 
the Real Estate Unit’s efficiency and project delivery. 

District View: 

Revision of Executive Limitation Policies needed. 

The District disagrees with the effect of the Real Estate Unit Manager not 
having the authority to make administrative settlements to avoid litigation 
when there are disagreements on property prices. Although legal 
proceedings are required to resolve an impasse with a property owner, 
they have not been shown to be costly, time consuming, or negatively 
impacting the District’s image. The Real Estate Unit has a very high 
success rate of equitably negotiating for real property without resorting to 
condemnation, and in treating property owners with respect. We do not 
believe there is a problem requiring further delegation of authority to the 
unit manager; however, this may be a best management practice worthy of 
consideration. A benchmark analysis will be conducted to determine if this 
is a practice worth incorporating. If so, a revision and/or CEO 
interpretation to Executive Limitation 5.9 would be required. This would be 
followed by revisions to the Real Estate procedures. 

CEO 6 

OFI 

Incorporate results-based 
measures into 
management of 
governmental relations 

Audit Recommendation: The District should revisit its set of performance 
measures for its governmental relations activities. The set should reflect a 
higher ratio of results-based measures to activity-based measures so that 
they will yield feedback that is more useful for the District. If the District 
has not already done so, it should determine which, if any, of its current 
governmental relations efforts could be more effectively or efficiently 
performed through an organization such as the Association of California 
Water Agencies (ACWA) or the American Water Works Association 
(AWWA), and which activities are best carried out by the District. 

District View: 

This recommendation does not take into account public affairs and 
government affairs best management practices and considerations for 
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Water Commission 

Assists the Board in formulating policy on issues regarding 
municipal and industrial water programs. 

Environmental Advisory 
Committee 

Advises the Board on issues of environmental restoration and 
enhancement. 

Agricultural Water Advisory 
Committee 

Assists the Board in developing policy regarding water supply for 
agricultural uses. 

Landscape Advisory Committee 

Assists the Board in developing landscape guidelines for water 
conservation. 

Lower Peninsula Flood Zone and 
Watershed Advisory Committee 


West Valley Flood Zone and 
Watershed Advisory Committee 


Guadalupe Flood Zone and 
Watershed Advisory Committee 

Makes recommendations for flood protection improvements for 
each zone from the perspective of the District’s priorities and 
financing policies. 

Coyote Flood Zone and Watershed 
Advisory Committee 


Uvas/Llagas Flood Zone and 
Watershed Advisory Committee 



Source: Santa Clara Valley Water District, 2005 


The Board of Directors reviews and approves the annual District budget recommended by the 
CEO. Though the District is an independent agency, its budget was also subsequently reviewed 
and subject to revision by the County Board of Supervisors during the time of Red Oak’s audit. 
This arrangement was specifically reviewed by Red Oak in June 2005 per the District’s request 
and is addressed in Attachment A. As described earlier in this memorandum, this will no longer 
be the case effective January 1, 2007. 

The District is governed in accordance with the tenets of the Carver Policy Governance Model. 
This model is characterized by key departures from the traditional board model of governance, 
which calls for a higher level of board involvement in planning, disassociates CEO performance 
from organizational performance, and relies primarily upon the board itself to communicate and 
reiterate its objectives rather than the CEO to interpret board policy. Some of the critical 
elements of the District’s application of the model include: 

• The Board develops “ends” and “limitation” policies for the CEO. The CEO is then 
expected to create a strategy to accomplish the ends within the given limitations. 

® The perfomiance of the CEO is regarded as identical to the District’s performance. 

• The Board relies upon the CEO’s interpretation of the Board’s policy directives in 
order to accomplish the ends. Such reliance is predicated on the strong leadership and 
effective communication of the CEO. 
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Recommendation 


information to its immediate customer base, at least at the “corporate” level 
of the organization. These include information on its level of cash reserves, 
its water rates, its staffing levels, its overhead rate, employee compensation, 
and related financial and utility management topics of direct interest to its 
ratepayers. 

The Office of Communications maintains a list of over a dozen customers 
and partners, but this list does not include such direct customers as water 
retailers, either individually or collectively, or private water well owners. 
The Office of Communications also tracks coverage of the District in the 
press, its website hits, and similar metrics, but the purpose of this tracking is 
not clearly defined. It is not clear how the efforts of the Office of 
Communications relate to any customer activities undertaken by the District 
at the operating group level. 


The District’s external stakeholders generally have unclear understandings or 
somewhat negative perceptions of all the financial/management 
characteristics of the District listed in the Cause box above, based on Red 
Oak’s external stakeholder activities for this audit. Whether these perceptions 
are simply a result of the lack of education by the District on these topics, or 
a result of the stakeholders’ perceptions being true was not clear from Red 
Oak’s audit activities at the CEO level. 

As a result, the District may be achieving its positive-image and community 
partnership goals with much of the public. However, the District is using 
survey and information tools that are outdated with respect to its current 
orientation and Baldrige-based customer emphasis, and may not be focusing 
its outreach efforts on its highest priority audience. 


In coordination with the recommendation in Finding No. 7, the District 
should refine its public information and stakeholder involvement efforts to 
create a better balance between its general and specific/customer outreach 
efforts. Specifically, the District should consider increasing the proportion of 
effort it spends on its immediate customers and the issues that most concern 
them. The District should also incorporate all key aspects of customer 
satisfaction into its performance measurement system, in coordination with 
its efforts related to Finding No. 5 and Attachment A. Again, please refer to 
the main body of the audit report for a discussion of communication efforts 
based on audit activities throughout the organization. 


Finding No. 9 - Opportuni 


Criterion 


The mission of each District department/work unit should directly support 
the mission of the District as a whole. To that end, the mission of the Office 
of the District Counsel should be clearly established and understood. 
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placement of the OEDI needs clarification and plans to work 
with the CEO to re-locate the OEDI within the District’s 
Administration organization. Red Oak was informed that it is 
typical for the District to roll out a new organizational unit or 
initiative directly under the CEO for a limited time (e.g., 1-2 
years) then house it in a more appropriate long-term 
organizational location., although this could not be 
substantiated with materials provided for Red Oak’s review. 
Information provided indicates this unit has been in 
existence and at its current level in the organization for a 
comparatively long time (7 years). 

Although merging of this unit/function into the 
Administration organization is already underway, the District 
may also want to investigate whether there are any cost 
efficiencies to be gained by having this unit’s functions 
delivered by existing units that are also responsible for 
ensuring legal and ethical behavior at the District, such as the 
District Counsel’s office and the Clerk of the Board. 
Although Red Oak appreciates this unit is charged with 
implementing programmatic diversity and inclusion events 
and not compliance or transactional activities involving 
diversity (currently covered by Human Resources), there is 
an opportunity to collaboratively address an opportunity for 
improvement regarding diversity and hiring noted later in 
this memorandum. 


The Records and Library Unit maintains the District’s 
central files and archives, but significant filing and record¬ 
keeping activity also occurs in the operating units. Red Oak 
recognizes that it is neither practical nor advisable to 
centralize all files within the District, but it is important to 
establish for internal and external stakeholders what unit is 
the legal custodian of records and has the responsibility and 
authority to administer the District’s records retention 
program. Concurrent with the changes to the Administrative 
Services/OD division as discussed above, the CAO plans to 
move the Records and Library Unit to the Information 
Management Division. This is consistent with the need for 
overall knowledge management and may further allow the 
District’s record-keeping and library services to take 
advantage of technology tools. Red Oak also understands 
that a Records Retention project is currently underway at the 
District. 


Page 13 of 66 


October 11, 2006 








responsibility. 

Between the time of Red Oak’s audit fieldwork and finalization of 
this and the other audit memoranda, the District reports that it has 
made significant progress in the H&S area. Specifically, the District 
has hired a new H&S manager, who is already underway with 
District-wide H&S program design and development to address the 
issues noted in this finding and in the main body of Red Oak’s final 
audit report. 


Finding No. 17 - Opportunity 

Key audit objective: “Management of human resources 


Criterion 

The District should complete and follow up on regular classification 
and compensation studies that meet industry standards, and take into 
account District employees’ full compensation packages, in order to 
be complete and allow comparisons to similar employers on an 
equal basis. 

References: 

• Board Policy EL-3 (3.6) 

• Baldrige -5.1(c): Work Systems - Hiring and Career 
Progression 

• Baldrige -5.3: Employee Well-Being and Satisfaction 

Condition 

• Based on information provided to Red Oak, 1999 was the 
last time a comprehensive, organization-wide classification and 
compensation study was completed at the District. Following this 
study, the District adopted a guideline that employee compensation 
should be at 60% of the “labor market.” 

• The District established a “labor market” that included four 
water districts, five cities, and one county. Although a few private 
industry comparisons were studied and considered, they were not 
included as private industry benchmarks in the final study. The 
District’s stated policy in this regard, however, is that private 
employers should be included in such studies (District Policy 5.1, 
Compensation: “It is the policy of this District that its employees 
shall be compensated at levels fairly and reasonably commensurate 
with those available for the same services in other areas of public 
and private employment...”) 
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• Data provided to Red Oak indicates that the number of 
senior managers relative to the size of the organization is increasing. 
In June 2001, there were 6B senior management positions (defined 
for this analysis as unclassified staff and unit managers); by June 
2005 this number increased 54% to 105, a somewhat larger increase 
than the organization as a whole over the same time period. One set 
of data provided to Red Oak indicates that the organization grew 
from 643 total authorized positions (FY 00/01) to 903 (FY 04/05), a 
40% increase. A separate analysis indicated an increase from 530 
employees in December 1998 to 758 in May 2005, a similar percent 
increase over time. 

• Auditees verbally informed Red Oak of some apparent 
imbalances in the designation, level of responsibility, or promotions 
between certain classifications; for example, the District had (as of 
May 2005 based on information provided to Red Oak) 26 “Senior 
Project Managers” and 2 “Project Managers.” This indicates that 
there is an opportunity to improve the naming of the positions, their 
respective levels of responsibility, or the control over which these 
positions are authorized, elevated, and/or filled. A more typical 
arrangement would be something like one “senior” member of a 
particular classification for every five or six “staff’ or “junior” 
members of a particular classification for a given organization. 

Cause Although during the most recent employee bargaining unit 

Memorandum of Understanding (MOU) renewal, two of the three 
District bargaining units commissioned their own studies of their 
respective units, a District-wide comprehensive classification and 
compensation study has not been completed since 1999. Despite 
adoption of the Interest-Based Bargaining (IBB) model and 
proactive dealings with its employee bargaining groups, the District 
has not placed a high priority on conducting sufficiently frequent 
agency-wide classification and compensation studies, on conducting 
such studies in line with industry standards, or on conducting such 
studies in line with its own stated policy to include private sector 
employers as compensation benchmark partners. 

Effect Because the benefits package is not considered along with salaries 

during the benchmarking process for District employee 
compensation and an up-to-date comprehensive assessment across 
all job categories is lacking, the District has difficulty substantiating 
its claim that District employee salaries are comparable to industry 
peers. Available current information, based on unit-specific or 
bargaining-unit specific recent studies, suggest, in fact, that District 
compensation levels significantly exceed those of its peers. 
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The District does not automatically fill vacant positions. Previously 
the chiefs would examine all vacancies at a given time and decide 
which to fill. Red Oak understands that now the chiefs are gaining 
the authority to move and/or replace empty positions within their 
departments. 

Auditees in Human Resources and throughout Administration 
indicated that diversity was a very important component in District 
hiring and filling of vacant positions. Red Oak was not able to locate 
a clear, specific policy regarding how diversity is incorporated into 
hiring decisions. This topic is discussed in further detail in the main 
body of the final audit report. 

Related to the topic of hiring prioritization, the District currently 
employs a large number of temporary staff, although auditees 
verbally indicated different totals, and the number was not made 
available to Red Oak in any of the employee counts or other 
documents provided. This is in some part due to the District’s 
“freezing” of approximately 90 positions in response to the State of 
California’s recent retraction of $51 million in District funding due 
to property taxes. In at least one case noted to Red Oak, the District 
has been relying on temporary workers for extended periods of time; 
specifically, the Real Estate Unit has been hiring temporary workers 
for at least 16 years. 

Auditees explained different rules regarding for how long, and for 
how many hours, a temporary worker may be hired at the District. 
Based on available documentation, Red Oak was not able to 
determine what the guidelines are for hiring temporary workers. 
Auditees indicated the following guidelines: (1) they can be 
employed for a maximum of 3 years at 960 hours per year, (2) they 
can be hired for a maximum of 6 months, with the possibility of one 
6-month extension, (3) “intermittent” workers can be hired for two 
years, and (4) there is no limit on the number of years that a District 
retiree can work as a “temporary” employee, provided he/she does 
not exceed 960 hours/year. 

In any case, unit manager auditees consistently express challenges 
with managing their units with temporary workers, namely, because 
of the relatively high turnover and need to frequently train incoming 
staff. Auditees believed they had to rely on the continuous stream of 
temporary workers because they were not allowed to hire a 
permanent employee to accomplish the same tasks. 
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• Baldrige - 4.1 Measurement, Analysis, and Review of 

Organizational Performance 

• Baldrige - 4.2: Information and Knowledge Management 

Condition The District has not implemented the integration points between major 

systems that would be expected of a high-performing large water agency. 
Typical best-practice integration arrangements are as follows: GIS-CMMS, 
GIS-WRIS, CMMS-ERP, and CMMS-SCADA. Furthermore, the District 
seems to have taken a “point-to-point” approach to integration rather than a 
standardized platform for enterprise integration involving commonly 
accessible data stores or a centralized messaging bus. 

It is noted that, in the case of CMMS-ERP ( Maximo-PeopleSoft ), the District 
has integrated the inventory information between the two systems. 

Cause The District has been diligent in identifying and satisfying the core user 

needs within the District. This involved implementing the major systems that 
support the District’s business processes. However, the District seems to 
have stopped short of integrating these different systems to further automate 
inter-system processes. 

Effect The District is still executing many processes manually by processing paper 

documents or re-keying information into different systems, rather than 
automating information flow between systems. This is currently behind the 
“state of the practice” with respect to its industry peers. This leads to 
inefficiencies and increased potential for error propagation in these processes 
that could be reduced or eliminated by automating data transfer between 
systems. 

Recommendation The District should identify all high-usage processes that involve the transfer 
of information (e.g., purchase orders, maintenance work orders) between 
systems and develop a plan to automate inter-system data transfer. This plan 
should focus on a standardized methodology for system integration using a 
common data architecture or enterprise application integration product. 
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Furthermore, there are no policies and procedures to control how 
much time District staff spend responding to BMRs and iBMRs, and 
the content and work associated with these requests. Naturally, 
requests from Board members are perceived by staff as top-priority 
matters, so they are addressed at the immediate expense of day-to- 
day operations. The portion of Executive Limitation EL-9 that calls 
for the CEO to elevate any request that would require significant 
staff effort as described above does not appear to be effective, either 
because it is not specific enough or because it is simply not 
followed. 

Effect 

Although staff time responding to BMRs and iBMRs is not tracked, 
staff report that days leading up to Board meetings are particularly 
busy (yet non-productive with respect to their core duties) due to the 
typically high volume of requests. Additionally, Board members are 
tempted by the BMR process to act in conflict with the main tenets 
of their policy governance model. 

Recommendation 

The District should elaborate on its Board policy regarding Board 
Member Requests and assign a single point of accountability for 
monitoring, tracking, and limiting staff time and money spent on 
responding to formal and informal Board Member Requests. 

To reinforce the policy governance model in this area, the Board and 
CEO should consider improving management of the existing 
BMR/iBMR process, for example, by determining a reasonable 
amount of staff hours/budget to be spent responding to any single 
BMR or iBMR. If staff anticipate spending more than this time limit 
on a single BMR or iBMR, the District may want to require that the 
request and the estimated response labor budget go back to the full 
Board for approval. If the item is approved, the District could assign 
it a project number and budget limit. 

Another option to consider is to not amend the current policy or 
procedures, but simply focus on unproved “self-policing” by the 
Board (and CEO). In other words, the District should consider 
ensuring that directives for significant new staff work are given a 
higher level of scrutiny before full Board approval and not approved 
or tracked along with simple clarifying information on agenda items 
or other relatively minor “requests” as the name “Board Member 
Requests” implies. 


All findings presented in this memorandum, particularly the recommendations, are to be 
considered as one component of the final audit report prepared by Red Oak. 
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Cause 


Using sponsorship provided by the CALFED Bay-Delta Watershed 
Program, this planning promotes coordination of activities dealing with 
flood protection, water supply, water quality, stream restoration, and parks, 
trails, and open space. 


Effect 


Watershed Stewardship Plans establish a systematic and comprehensive 
understanding of baseline conditions, provide data and context for 
undertaking CEQA analyses, and provide context for designing 
improvement projects, 


Watershed Operations Opportunity for Improvement Finding No. 1 
Key Audit Objectives: “Operational policies and procedures ” 
"Environmental management” 
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• Staff charged with ownership of the overall asset management 
program within the WUE 

@ Appropriate Computerized Maintenance Management System 
(CMMS) software in use to facilitate effective asset management 

• An Annual Maintenance Plan to guide each year’s maintenance 
activities according to system priorities and planned asset needs. 
(Formerly maintenance or engineering services were requested and 
delivered according to individual work orders.) 

However, like most of its peers, the District and the WUE have a number of 
significant additional steps necessary before asset management is fully 
functional agency-wide and able to be carried out over the long term. 
Specifically: 

• There are currently different asset management/database systems and 
methodologies in place across the agency 

• Documentation provided to Red Oak did not indicate a procedure for 
the incorporation of new assets into the existing system(s). 

• Documentation provided to Red Oak did not indicate an agency¬ 
wide vision or plan for the full implementation of asset management. 

® Long-temi asset management needs are forecasted but no mechanism 
is yet in place to fund them. All WUE auditees involved with asset 
management and/or the District’s finances recognize that forecasted 
water rates will be insufficient to meet the WUE’s future asset 
management and infrastructure needs. Please refer to the Watershed 
Operations audit memorandum for an analogous finding regarding 
future funding in that area. 

Additionally, District staff provided Red Oak with a detailed analysis they 
prepared indicating a generally declining trend in recent years in District 
resources (both human and financial) directed to asset management and 
maintenance while maintenance needs and number of assets were 
increasing. This is also echoed in the District’s in-house look at its long¬ 
term water supply sustainability, as well as the WUE’s Business Plan. 
Although a detailed staffing level analysis is outside the scope of this audit, 
the preparation of these analyses by staff underscores the finding in Red 
Oak’s Administration audit memorandum that indicates the District as a 
whole would benefit from a more rigorous and consistent job of assigning 
human resources according to business needs across the District. 
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References: 

o Board Policy E-4.2 

o Baldrige Criterion 3.1.a.l: Customers, customer groups, and market 
segments 

o Baldrige Criterion 3.2.a.l: Customer relationships, meeting and 
exceeding expectations 

Condition 

CPS has defined their “customers” to be the public, and all other entities 
involved in successfully delivering capital projects (e.g., cities) as “partners.” 
This is commendable, and helps foster a sense of shared purpose in terms of 
jointly delivering successful capital projects for the benefit of the end user. 

The District’s recognition of its “partners” and “customers” is addressed at 
the District-wide level in the main body of the final audit report. 

Cause 

CPS currently has a strong emphasis on communication with public 
customers and working in cooperation with internal and external entities. 

Effect 

This results in CPS project staff having an increased understanding of the 
goals and objectives of their customers and partners. As noted above, this 
topic is discussed at the District-wide level in the main body of the final 
audit report. 


Capital Program Services Strength Finding No. 4 

Key Audit Objectives: “Management of the capital program ” 

_ “Operational policies and procedures ” 


Criterion 

The District should have a clear process for planning and subsequently 
prioritizing its capital projects over a defined period (e.g., five years). This 
planning and priority-setting process should support the District’s overall 
strategic business plan, and directly support the business plans of the 
District’s operating groups (Water Utility Enterprise and Watershed 
Operations). 

References: 

o Baldrige Criterion 2.1.b.l: Goals for meeting strategic objectives 

Condition 

CPS is to be commended for publishing its first 5-year rolling Capital 
Improvement Plan (CIP) in 2006. At the time of Red Oak’s CPS audit 
fieldwork, this document was in the public review period and was to be 
submitted thereafter to the Board of Directors for approval. Projects are 
ranked according to criteria that assess the project’s value in terms of the 
District Board’s Ends Policies, Executive Limitations, and the “Cleaner, 
Greener, Leaner” vision of the District. 
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First, alternative project delivery approaches would require the District to use 
external consultant services, which is considered by staff to be counter to the 
spirit of Executive Limitation 3.7, which essentially states that the District 
should not engage external resources if the same work can be completed in- 
house. 

Additionally, firms that have the ability to provide such services are 
necessarily large films, while the District is striving to increase access for 
small/local businesses to compete for the District’s contract opportunities per 
the Board’s Ends Policy 4.2.1. 

Finally, although alternative delivery approaches have the advantage of often 
saving time and costs for total project delivery, inherent in the approach is 
the higher probability of change orders during construction. This is because 
with the same firm responsible for both design and construction, the design 
phase need not be perfoimed to “perfection,” and final changes can often be 
efficiently handled during the construction phase. However, CPS 
management reports that District staffs general interpretation is that the 
Board’s view on construction change orders is negative, regardless of 
delivery approach employed, and that they equate change orders with poor- 
quality work. Accordingly, staff perceive that implementing alternative 
delivery approaches would require a higher number of change order 
approvals from the Board on a given project. 

Effect 

CPS currently (1) does not evaluate whether the District would realize 
benefits by implementing one of the alternative delivery approaches noted 
above for a particular project and (2) is not equipped to take advantage of 
those potential benefits by implementing an alternative delivery approach if 
deemed beneficial. 

Recommendation 

The District/CPS should systematically evaluate and implement, when 
appropriate, alternative delivery approaches to capital projects. Although 
staffs concerns as listed in the “Condition” statement above are valid, given 
the District’s traditional Design-Bid-Build approach employed to date, they 
strongly suggest the opportunity for orientation at both the Board and District 
CEO/staff levels to the current “state of the practice” regarding alternative 
capital project delivery approaches and benefits employed by many of the 
District’s peers. Efforts such as employing alternative delivery approaches 
when cost-effective will also help the District cope with the rapidly and 
significantly increasing construction costs resulting from global demands on 
construction materials and services noted in the introductory paragraphs of 
this audit memorandum. 

Although the potential for change orders is typically higher with an 
alternative delivery approach, this is a measure that should not be considered 
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on its own. In other words, the efficiency associated with having the same 
firm responsible for both a project’s design and construction phases typically 
means that an abbreviated design phase can be employed, generally 
outweighing any additional costs or inefficiencies associated with additional 
change orders and resulting in a lower overall cost for the same project. 

The District may wish to consider the use of pilot alternative delivery 
projects to more fully understand the potential benefits of alternative capital 
project delivery when applicable. These pilot projects should provide CPS 
with criteria to systematically evaluate alternative delivery in the project 
initiation stage (Q72101) based on die size, complexity, and nature of the 
project. CPS has already identified at least one candidate for such a pilot 
project. 

Red Oak also recommends focused dialogue between CPS management/staff 
and the District Board/leadership regarding industry trends and the state of 
the practice regarding alternative delivery approaches, such that staffs 
concerns about moving forward with alternative delivery considerations can 
be addressed. 


Capital Program Services Opportunity Finding No. 2 
Key Audit Objectives: “Management of the capital program ” 

“Operational policies and procedures ” 


Criterion 

CPS should establish formalized partnerships with the “owners and 
operators” of the facilities it delivers, namely, the Water Utility Enterprise, 
Watershed Operations, and Administration. Furthermore, CPS should 
formalize the partner expectations by partner segment and track results 
relevant to the expectations to assure that CPS is meeting and/or exceeding 
the requirements of its partners. 

References: 

o Baldrige 3.2: Customer relationships and satisfaction 

Condition 

Project Plans are developed per the standard approach outlined in the ISO- 
defined QMS. This Project plan serves as an internal “contract” for project 
roles and responsibilities for staff within CPS and throughout the District. 
The Project Plan is generally well-documented. In practice, however, there 
are opportunities for clearer understanding of individuals’ organizational 
roles and project roles. Auditees consistently reported that engineers 
experience confusion between their unit-based responsibilities and their 
individual project-based responsibilities, and furthermore, that project 
managers and unit managers experience confusion on appropriate staff 
direction and time allocation in these areas. 
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Conduct an evaluation of the methods and practices used by the District to maintain a 

positive District image and build community partnerships as stated in the Board 's Ends 
Policies (E-4) 

3.2.1 Conduct background research 

• Review documents 

• Review results of Board audit to extent available 

• Review representati ve sampling of District outreach materials 

• Interview CEO for insights 

3.2.2 Develop audit approach 

• Identify potential audit criteria, including Carver model and Baldrige criteria 

• Select critical criteria for audit 

• Establish appropriate timeframe to be audited 

• Determine how the condition will be measured for comparison to criteria and 
how conclusions will be validated with District representatives 

• With assistance from District staff (P. Flynn, R. Callender), identify District 
stakeholders knowledgeable about District outreach approach and materials, 
as well as legislation-related District efforts. 

• Prepare audit instruments and detailed work plan 

• Conduct internal and client review, revise 


Progress Milestone3,2.2 . $16,t550 


3.2.3 Conduct audit fieldwork/deskwork 

• Execute specific audit tasks and draft findings for each 

• Per audit approach defined in 3.2.2, contact stakeholders and/or other 
recipients of District outreach materials to obtain feedback on quality, 
relevance, and effectiveness of the materials and District efforts. 

• Review findings in field with those directly involved, if possible, and 
document feedback 


Progress Milestone 3.2.3.' /'• " $20*423 v/cC 2 v-CvP 


3.2.4 Prepare memorandum of findings 

• Prepare draft for internal team review 

• Revise and review with appropriate client representatives (validation meeting) 

• Finalize memorandum of findings 

Task 3.2 Assumptions 

Meetings: 1 total (1 validation meeting) 

Interviews: 1 individual interview 
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9 Review procurement function 

• Execute other specific audit tasks and draft findings for each 

9 Review findings in field with those directly involved, if possible, 
and document feedback 

3.33.5 Prepare memorandum of findings 

• Prepare draft for internal team review 

• Revise and review with appropriate client representatives 
(validation meeting) 

• Finalize memorandum of findings 


Task 3.3.3 Assumptions 

Meetings: 1 total (1 validation meeting) 

Interviews: 1 individual interview and 1 group interview 
Deliverables: 1 preliminary draft and 1 final draft 
memorandum of findings, delivered electronically 


Progress Milestone 3.33 


/ $20,496 . 


3.3.4 Information Management 

3.3.4.1 Develop plan and schedule for background research 

33.4.2 Conduct background research 

• Review documents, including business planning (goals, objectives, 
approaches, action plans, etc), policies and procedures, workload 
and performance statistics, and organizational “charter” 

• Interview Deputy Administrative Officer 

33.4.3 Develop audit approach 

• Identify potential audit criteria, including Carver model, Baldrige 
criteria, internal metrics and PMI guidelines 

• Select critical criteria for audit 

• Establish appropriate timeframe to be audited 

• Determine how the condition will be measured for comparison to 
criteria and how conclusions will be validated with District 
representatives 
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• Prepare audit instruments and detailed work plan, consistent with 
Category 4 of the Baldrige criteria (knowledge management) 

• Conduct internal and client review, revise 


Progress Milestone.3.3.4.3 ’ $11,399 


3.3.4.4 Conduct audit fieldwork/deskwork 

• Conduct 4 additional interviews 

• Review training and development programs 

• Review IS Master Plan and progress against plan 

• Review documented data management strategies, standards, 
efficiency improvement projects (e.g. server consolidation) and 
general technology strategies 

• Review current and recently completed project reports 

• Review staffing levels 

• Ensure that the Information Management function is acting in 
support of the District’s core functions and strategies 

• Execute other specific audit tasks and draft findings for each 

• Review findings in field with those directly involved, if possible, 
and document feedback 


Progress Milestone 3.3.4.4 f 



3.34.5 Prepare memorandum of findings 

• Prepare draft for internal team review 

■ • Revise and review with appropriate client representati ves 
(validation meeting) 

* Finalize memorandum of findings 


Task 3.3.4 Assumptions 
Meetings: 1 total (1 validation meeting) 
Interviews: 5 individual interviews 
Deliverables: 1 preliminary draft and 1 final draft 
memorandum of findings, delivered electronically 


Progress Milestone 3.3 4.5 ' $5,083 


3.3.5 Human Resources 

3.3.5.1 Develop plan and schedule for background research 

3.3.5.2 Conduct background research 
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9 Review documents, including business planning (goals, 
objectives, approaches, action plans, etc), policies and procedures, 
workload and performance statistics, and organizational “charter” 

• Interview Deputy Administrative Officer 

3.3.5.3 Develop audit approach 

• Identify potential audit criteria, including Carver model, Baldrige 
criteria, internal metrics, human resources journals, EH&S permit 
requirements, and local labor-pool demographics 

• Select critical criteria for audit 

• Establish appropriate timeframe to be audited 

• Determine how the condition will be measured for comparison to 
criteria and how conclusions will be validated with District 
representatives 

• Prepare audit instruments and detailed work plan 

• Conduct internal and client review, revise 

3.3.5.4 Conduct audit fieldwork/deskwork 

• Conduct 4 additional interviews 

• Review training and development programs 

® Identify current processes and practices and establish baseline 

• Review classification and compensation plan, recruiting practices, 
benefits administration, occupational health and safety program, 
and collective bargaining approach 

• Evaluate effectiveness against audit criteria in areas such as EH&S 
and other regulatory requirements, financial performance, 
customer service, and utilization of technology 

• Execute other specific audit tasks and draft findings for each 

• Review findings in field with those directly involved, if possible, 
and document feedback 

3.3.5.5 Prepare memorandum of findings 

• Prepare draft for internal team review 

• Revise and review with appropriate client representatives 
(validation meeting) 

• Finalize memorandum of findings 


Task 3,3.5 Assumptions 

Meetings: 1 total (1 validation meeting) 

Interviews: 5 individual interviews 

Deliverables: 1 preliminary draft and 1 final draft 

memorandum of findings, delivered electronically 
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4.2.7 Incorporate comments received and produce final Summary Audit Report 


Task 4.2 Assumptions 
Meetings: 1 
Presentations: 2 

Deliverables: 1 draft set of recommendations, 1 draft Summary Audit 
Report (expected to be approx. 50 pgs), 1 set of presentation slides , and ] 
final Summary Audit Report. Final report will be delivered electronically 
(CD), with a limited number of hard copies (up to 6) prepared and 
delivered by the Consultant 



5.0 Optional Services 

Based on available information, this scope presents the Consultant’s best approximation of the 
j: activities necessary to complete the audit objectives as described in the District’s Request for 

Proposals. However, the District and the Consultant recognize that during the performance of 
this audit, unanticipated areas of needed inquiry may arise. Specifically, additional topics than 
j those described in this scope may need to be investigated, or additional document review or 

'! interview activities beyond those described in this scope may be necessary to satisfy the audit 

objectives. 

Igg 

Therefore, Task 5.0 is a set-aside for any such optional services necessary, with a scope and 
budget to be defined if and when necessary. Such optional services may include preparation 
! of an interim audit report for the District to share with Santa Clara County following Tasks 

3.1, 3.2, and 3.3; additional external stakeholder interviews or research beyond those efforts 
described in this scope; assistance with the District’s “staff awareness” efforts prior to audit 
j phases, or other services as deemed 'necessary. The Consultant will proceed with any optional 

tasks only following discussion with, and prior written approval from, the District’s Ad Hoc 
Audit Committee Chairperson, 


VIII. Changes to the Scope of Work or Consultant Personnel 

< A. Pursuant to Task 2.5 of the Scope of Work (above), the Consultant, the Chair of the 

District’s Ad Hoc Audit Committee and the District’s Contract Manager will: 

i 


APPENDIX ONE - SCOPE OF SERVICES 


Page 31 of 32 













{! r j i jd p .r jj ej nsJV^ 

Parlor minc'd .alj d j i 

f inal rtzpori 










List of Acronyms 


AICPA 

AOO 

APWA 

ASCE 

AWWA 

BAWAC 

BL - (#) 

BMR 

BOD 

CADD 

CAO 

CAPE 

CAS 

CEO 

CEQA 

CFO 

CIP 

CM 

CMMS 

COB 

COO 

CPAR 

CPS 

CUWA 

CVP 

DAO 

DOO 

DWR 

E - (#) 

EDMS 

EIR 

EL - (#) 

ERP 

FAR 

FAHCE 

FEMA 

FSD 

FY 

GAGAS 

GAO 

GASB 

GFOA 

GIS 

GP - (#) 


iur> 

'•* CONSULTING 


American Institute of Certified Public Accountants 

Assistant Operating Officer 

American Public Works Association 

American Society of Civil Engineers 

American Water Works Association 

Bay Area Water Agencies Coalition 

Board-CEO Linkage policy number 

Board Member Request 

Board of Directors 

Computer-Aided Drafting and Design 

Chief Administrative Officer 

California Awards for Performance Excellence 

Contract Administration System 

Chief Executive Officer 

California Environmental Quality Act 

Chief Financial Officer 

Capital Improvement Plan 

Construction Management 

Computerized Maintenance Management System 

Clerk of the Board 

Chief Operating Officer 

Corrective and Preventive Action Request 

Capital Program Services 

California Urban Water Agencies 

Central Valley Project 

Deputy Administrative Officer 

Deputy Operating Officer 

California Division of Water Resources 

Ends policy number 

Electronic Data Management System 

Environmental Impact Report 

Executive Limitations policy number 

Enterprise Resource Planning 

Federal Acquisition Regulation 

Fishery and Aquatic Habitat Collaborative Effort 

Federal Emergency Management Association 

Financial Services Division 

Fiscal Year 

Generally Accepted Government Auditing Standards 
General Accounting Office 
Governmental Accounting Standards Board 
Government Finance Officers Association 
Geographic Information System 
Governance Process policy number 
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Section 3 

Project Goal, Scope, and Methodology 


9 Audit Committee Meeting No. 1 - Board and CEO Interim Findings: October 11, 
2005 

9 Audit Committee Meeting No. 2 - Administration and Finance Interim Findings: 
April 17, 2006 

® Audit Committee Meeting No. 3 - Watershed Operations, Water Utility 
Enterprise, and Capital Program Services Interim Findings: July 25, 2006 

• Audit Committee Meeting No. 4 - Summary Audit Report: October 3, 2006 


3.7. Views of Responsible Officials 


A key aspect of the GAGAS reporting requirements is that audit reports include “Views of 
Responsible Officials,” the auditee’s formal response to the audit. During the validation 
process, the auditor and auditee work closely together to ensure that the auditor is 
provided with accurate and complete facts and that the context of the organization is 
appropriately recognized in the development of the auditor’s findings. This process is 
reflected in the findings contained in the final audit report prepared by the auditor. 

The requirement for “Views of Responsible Officials” recognizes that there may be input 
the auditee may wish to provide and document beyond that necessary for the findings 
validation process. This may be additional information that was not immediately relevant 
to the audit findings, but applies to how the auditee will address the finding in the future. 
The “Views of Responsible Officials” section is also designed to document any particular 
agreements or disagreements the auditee may have with the auditor’s findings. It is often 
the case that although the auditor has the full and accurate facts, and develops findings 
(including recommendations) accordingly while acknowledging the context of the 
organization, the auditee may have a different perspective. The “Views of Responsible 
Officials” recognizes that this perspective is important to document to ensure a complete 
audit report. 


3.8. “Metric” Benchmarking and “Process” Benchmarking 


During the course of this audit, District staff and Audit Committee members expressed 
interest in the topic of “benchmarking” and what type of benchmarking Red Oak was 
applying to this performance audit. To best meet the District’s audit scope of work and 
needs, Red Oak applied “process” benchmarking to this project in favor of “metric” 
benchmarking. The differences between the two, and the relative benefits of process 
benchmarking, are discussed in the following two subsections. Of primary importance is 
that the District has adopted a highly process-oriented management model (Baldrige) to 
frame its performance management approach, so a corresponding process-benchmarking 
approach to this audit was selected. The reader will note that several of the findings in this 
report discuss the District’s level of performance (“condition”) relative to its agency peers. 
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Section 7 

Baldrige Category 1 - Leadership 


The Board of Directors has created nine advisory committees to aid the Board in policy 
development in key strategic areas. These committees are coordinated by the Office of 
CEO/Board Support and are intended to serve as a link by which the Board members can 
take into account the desires of the community when making decisions. However, the 
committees rely significantly on the efforts of staff to set agendas and provide any 
necessary data, though they are attended by and led by Board members. This makes the 
committees susceptible to allowing Board members to exercise direct authority over staff. 

To address this, and maximize the potential benefit of the Carver model, the Board should 
set clear boundaries on its use of its community advisory committees to ensure they are 
not used as a means to direct District staff and to ensure their use remains consistent with 
Board policies. In addition, the CEO’s interpretation of Board policy regarding direction 
to staff should take into consideration the existing working relationship between Board 
members and District staff on the advisory committees. (See also Appendix A - Board of 
Directors Audit Memorandum Finding No. 6.) 

In addition, the current Board Member Request/Informal Board Member Request 
(BMR/iBMR) system offers Board members a potential conduit to circumvent their policy 
governance model by directing staff to implement substantial projects in addition to 
simply requesting clarifying information. Based on the list of recent BMRs and iBMRs 
provided for Red Oak’s review, this has happened on several occasions in the past year 
(2004-2005). (See also Appendix C - Administration Audit Memorandum Finding No. 
37.) 

To reinforce the policy governance model in this area, the Board and CEO should consider 
improving management of the existing BMR/iBMR process, for example, by determining a 
reasonable amount of staff hours/budget to be spent responding to any single BMR or 
iBMR. If staff anticipate spending more than this time limit on a single BMR or iBMR, the 
District may want to require that the request and the estimated response labor budget go 
back to the full Board for approval. If the item is approved, the District could assign it a 
project number and budget limit. Another option to consider is to not amend the current 
policy or procedures, but simply focus on improved “self-policing” by the Board (and 
CEO). In other words, the District should consider ensuring that directives for significant 
new staff work are given a higher level of scrutiny before full Board approval and not 
approved or tracked along with simple clarifying information on agenda items or other 
relatively minor “requests” as the name “Board Member Requests” implies. 

By addressing this area, the District could improve its work system results as would be 
evaluated in Baldrige Item 7.4 as it relates to “current levels and trends in key measures or 
indicators of work effectiveness.” 


7.2. Policy Governance - Conclusion 


The District is to be commended for implementing a structured, formalized policy 
governance model. However, the lack of Board Policies for some key operational areas of 
the District, some inconsistency in the levels of CEO interpretations of Board Policies, and 
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CAP 

E 2005 

Strengths 

Areas for Improvement 

Policy Governance Model and Alignment 

External Input 

Model ensures that Board policies are in place 
to guide CEO and staff behaviors and actions, 
and the Board monitors CEO performance on 
an ongoing basis. 

Input from customers, end users, suppliers, 
competitors, partners, visitors, and other 
stakeholders are not gathered and used. 

Strategic Plannina Approach and Scorecard 

Development of New or Improved Applications 

System 

Systematic planning approach within each 
major organizational part of the District. New 
approach is to create an ongoing strategic 
planning process that is driven by the 
organization mission and vision. 

Many systems and applications are not yet 
deployed. 

Action Plan Development and Deployment 

Knowledae Management 

Each major part of the District prepares an 
action plan that is used in setting priorities 
and budget allocations. 

Does not appear to be a systematic approach in 
place to make data and information available. 

Customer Relationship Buildina 

Key methods for building relationships with 
each of the seven customer groups have been 
identified. 

Needs of Diverse Workforce 

Does not employ systematic approaches to tailor 
its work and jobs, employee education and 
training, work environment, and employee 
support environment to meet the needs of its 
diverse workforce. 

Employee Education and Training 

The District delivers education and training via 
a variety of meetings. 

Operational Performance Data 

Current operational performance data is not 
widely available for many key measures. 

Operational Performance Data 

Excellent performance in meeting strategic 
challenges of public expectation for quality of 
life. 

Comparable Data 

Lack of relevant comparable data. 

Trend Data 

Lack of trend data. 

Key Results 

Not available for many areas of importance. 
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Cause 

The members of the Board are experienced and conscientiously dedicated to 
ensuring effective communication among Board members. 

Effect 

Though disagreements do arise among Board members, once the group 
reaches a decision as a team, the Board members put aside any previous 
dissention to work collaboratively. This is evidenced by the consistency with 
which the Board is able to vote unanimously on Board agenda items. 
Effective communication and a commitment to work together are essential 
for Board members to engage in healthy discussions on all items before 
them, regardless of the magnitude or nature of any disagreements they may 
have. 


Finding No. 2 - Strength 


Criterion 

The Board should actively seek to include community stakeholders in the 
deliberations and activities of the District. 

Reference: 

• Board Policies: GP-2.3, GP-3.1, GP-7.1, and GP-10.1.3 

• Baldrige Senior Leadership: 1.1 b(2) 

• Baldrige Customer and Market Knowledge: 3.1a(2) 

® Baldrige Customer Relationships and Satisfaction: 3.2 

Condition 

The Board performs effective outreach to the community through their 
participation in community advisory committees, public meetings/workshops 
about District projects, and other efforts to inform stakeholders of District 
activities. The input of the community is used as an additional data point of 
consideration in the District’s efforts to reach consensus on various 
operations and activities. 

Cause 

The members of the Board have taken an active interest in ensuring that they 
consider the input of the community in governing the District, and are active 
at the local, state, and federal levels in the District’s core service areas (e.g., 
water supply policy). 

Finding No. 3-0 

pportunity 

Criterion 

The Board should set policies to appropriately establish and effectively 
manage the cash reserves of the District, and to provide general guidelines 
for sources of funding and financing of District capital projects. 

Reference: 

• Board Policy: EL-4 

• Baldrige Governance and Social Responsibilities: 1.2a(l) 

• Baldrige Measurement, Analysis, and Review of Organizational 
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Chief Executive Offices Audit Memorandum with 
Review of District’s Performance Measurement 
Program Memorandum Attachment 









Condition 



Effect 


District, for example, in the form of Business Plans, individual work plans, 
or other quantifiable performance plans and indicators. 

Reference: 

© Board Policies: EL-9.1, EL-9.2, EL-9.4, and EL-9.6 
© Baldrige Strategy Development: 2.1b(l) and 2.1b(2) 

© Baldrige Strategy Deployment: 2.2a(l) and 2.2a(5) 

© Baldrige Measurement, Analysis, and Review of Organizational 
Performance: 4.1a(l), 4.1b(l), and 4.1b(2) 


The CEO has engaged in dialogue with the Board over his interpretations of 
the Board’s policies, but the results of these efforts are not fully reflected in 
the current set of Board governance policies (July 2005). The CEO’s 
interpretations of the Ends Policies as currently documented also vary 
significantly in specificity, and some essentially defer interpretation to the 
Board (e.g., 3.1.1., on the topic of watershed protection/restoration). As a 
result, executive managers who are charged with leading the District’s 
functional areas do not have a consistent understanding of the CEO’s 
interpretations. 

The CEO’s interpretations of the Ends Policies have also not been translated 
into business plans and/or measurable performance metrics consistently 
across the organization, or in a consistent manner. The Watershed Operations 
group has developed a fifteen-year plan for creek maintenance and flood 
control activities, while the Water Utility Enterprise prepares an annual 
business plan. The most recent water utility business plan (FY 2005) does 
link to the Board’s Ends Policies and CEO interpretations to the extent 
possible, and includes prioritizations developed by the Water Utility 
Enteiprise. 

However, the District has not developed business plans (or their equivalent) 
for the Administration or Capital Program Services departments. In contrast 
to the water utility’s reliance on its business plan for prioritization of 
activities, the Capital Program Services Deputy Operating Officer reports 
having no reference by which to prioritize the implementation of capital 
improvement projects at the District. 


The District has not placed a priority on rigorous, quantitative CEO-level 
interpretation of the Board’s policies and translating those interpretations 
into its operations. Inconsistent format and state of plan development are 
found across the District regarding (1) the level of clarity on the CEO’s 
interpretation of the Ends Policies and (2) format and development of plans 
linking the Ends Policies and their CEO interpretations to the day-to-day 
operations of the District. 


In many cases, operating groups and staff feel they have no system or 
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All findings presented in this memorandum, particularly the recommendations, are to be 
considered as one component of the final audit report prepared by Red Oak. 

Views of Responsible Officials 

“Views of Responsible Officials” are included as a component of the main body of the final audit 
report. 

Nature of Any Privileged or Confidential Information Omitted 

No privileged or confidential information was omitted from this audit memorandum. 

References 

The reference list for this and all audit memoranda is included in the main body of the final audit 
report. 

Attachment - September 9, 2005 “Review of Santa Clara Valley Water District’s Performance 
Measurement Program” memorandum 
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2. Reviewed the following documents provided to Red Oak by the District: 


o Eureka Award Application for the California Awards for Performance 
Excellence (CAPE) Program (July 2005) 

° Office of Performance Excellence Summary Slides (2005)Ends Quarterly 
Monitoring Report (Ql, FY 2005) 

° Initial CEO Scorecard - Summary (Nov. 2004) 

o California Council for Excellence California Prospector Feedback Report 
(Sept. 2004) 

o Water Utility Enterprise Annual Business Plan, Fiscal Year 2005 (July 
2004) 

® California Council for Excellence California Prospector Application (June 
2004) 

o 15-Year Plan to Preserve & Protect our Quality of Life: Clean, Safe 
Creeks & Natural Flood Protection (July 2000) 


3. Met with Mr. Sakai and Denise Uriarte of the Office of Performance Excellence 
via telephone conference on July 28, 2005 to validate findings, ask questions 
following the document review, and discuss Red Oak’s preliminary 
recommendations. 

4. Discussed performance measurement with selected members of the District’s 
Executive Leadership Team during August 2005 interviews conducted as part of 
the Board of Directors (Board) and Chief Executive Officer (CEO) components of 
the Comprehensive Performance Audit. 

Summary of Existing Performance Measurement System 

Prior to 1999, the information provided by District staff to the District’s Board of 
Directors had not been organized according to a consistent set of District-wide 
performance measures. Additionally, information related to the water supply, flood 
control/watershed, and capital project functions of the District was generated 
independently, according to the separate strategic plans that each of these major 
organizational areas owned. As a result, the District’s Board members were typically 
presented with a large volume of District operational information prior to their regular 
meetings, much of which was not organized, summarized, or particularly relevant to the 
Board’s policy-level needs. 

To address this situation, as part of the water utility audit conducted in 1999, Malcolm 
Pirnie recommended (and the District subsequently developed and implemented) a more 
structured and concise method of reporting information to the Board. Specifically, the 
District developed a set of high-level performance measures that incorporated 
information from numerous lower-level (detailed) data points and therefore concisely 
conveyed a more appropriate level of information to the Board members. 
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Summary of Results 

In summary, Red Oak’s initial findings were in close agreement with the District’s own 
understanding of the strengths and areas for improvement of its existing program. The 
suggested recommendations presented by Red Oak to District staff on the July 28 
teleconference were also generally aligned with ongoing system improvement efforts 
already underway at the District. The following sections of this memorandum summarize 
the strengths, opportunities for improvement, and recommendations developed by Red 
Oak. 

Strengths 

The fact that the District recognizes the need for and is developing an integrated 
performance management system that is aligned with its vision distinguishes them from 
many of their utility peers. Such a program is considered a best practice among leading 
organizations. Red Oak identified a number of specific strengths of the District’s existing 
performance measurement program: 

1. The District has developed a thorough series of measures that should provide 
them with an adequate picture of their performance across their core business 
functions. 

2. The use of a multi-tiered system can allow the District to develop relevant 
measures at each level of the organization. It also allows for integration of the 
measures into a “nested” performance measurement program. 

3. Executive managers and their deputies are evaluated quarterly based on their 
unit’s or division’s performance as indicated by the measures. Their work plans 
are directly linked to the measures. 

4. The quarterly monitoring reports allow for thorough reporting against the District 
Board’s Ends policies. 

5. Graphic representation of measured outcomes allows for easy identification of 
whether measures meet their respective targets. 

6 . Inclusion of descriptive information with the measures allows for an 
understanding of what the measure is, how it is collected, how performance is 
influenced, and what the performance means. 

Opportunities for Improvement 

Red Oak identified a number of opportunities for the District to continue to improve its 
performance measurement program. 
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“Assess the effectiveness and efficiency (including compliance with applicable laws) of: 

a. Risk management/insurance costs: 

i. Assessment ofpotential risks and adequacy of reserves 

b. Management of human resources: 

i. Assess policies, procedures, and practices for recruitment, retention, safety, 

and diversity 

c. Information management: 

i. Management of information technology 

ii. Measurement and knowledge management (to be incorporated as a theme 
throughout the audit) 

d. Management of real property owned by the District and physical assets - facilities and 
infrastructure” 


Please note that although the District’s financial functions are also organizationally housed 
within Administration, Red Oak’s financial audit of the District is presented in a separate 
memorandum, due to its relatively high importance to the District and large number of audit 
objectives in Red Oak’s scope of work. 

The fieldwork for the Administration audit consisted of the following components: 

• Document reviews 

• Individual interviews with the Chief Administrative Officer (CAO) and Deputy 
Administrative Officers (DAO) (4) 

® Individual interviews with selected Unit Managers (18) 

• Individual interviews with selected internal stakeholders of Administration (2; the Chief 
Operating Officers of Watershed Operations and the Water Utility Enterprise) 

• Individual interview with the Clerk of the Board 

• Group interview with three selected Unit Managers within General Services 

• Questionnaires completed by Administration DAOs and unit managers interviewed 

® Follow-up telephone conversations with selected interviewees to confirm facts or inquire 
about additional available information. 

Following the fieldwork and preparation of an internal draft version of this memorandum, Red 
Oak provided each of the Deputy Administrative Officers and selected Unit Managers with 
preliminary excerpts from this memorandum pertinent to their area(s) of responsibility and 
validated the preliminary findings verbally with them to ensure their factual accuracy and 
relevance. Red Oak incorporated information from these preliminary validation meetings, and 
then presented a summary of this memorandum to the CAO. Red Oak incorporated input from 
the CAO and presented the resulting findings and recommendations to the Audit Committee on 
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Cause 

The District has not typically assigned priorities to its various job 
classifications or positions. There is no system to expedite the hiring 
process for an urgently needed position (e.g., a position responsible 
for immediate/daily operational or regulatory compliance) as 
compared to a position responsible for more longer-tenn or less 
immediate duties. 

Effect 

One effect of the District’s inability to hire and retain essential 
positions is described in the Health & Safety finding earlier in this 
memorandum. In another case (long-term vacancy of a small-parts 
inventory position), a group of staff-level employees formed an ad- 
hoc committee of sorts to circumvent the process described above 
and appeal to the CAO due to the long-term vacancy of their 
position. In general, the effect of this condition is that the District 
has not had a systematic method by which it can quickly fill 
immediately needed positions as compared to those that are less 
urgent. 

Recommendation 

The District should establish and adhere to a hiring priority list 
based on the relative position importance to the core business of the 
District. One method for accomplishing this is for the CEO, in 
cooperation with the chiefs, to establish the list and task Human 
Resources with implementing the list when responding to position 
requests from unit managers under the current hiring approach. The 
District has indicated to Red Oak that, since the time of the audit 
fieldwork, it has already initiated discussions regarding 
implementation of such a priority list or otherwise addressing this 
audit finding. 


8. Information Management Findings 


Finding No. 20 - Strength 

Key audit objective: “Information management ” 


Criterion 

The District should establish IT-related policies and procedures with respect 


to appropriate use of information resources, system security, and user 


privacy. 


References: 


• Board Policies EL-3.1 & EL- 7.5 


• Baldrige - 4.2a (2): Information and Knowledge Management 
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Recommendation 

The Real Estate Unit Manager should work with the Chief 
Administrative Officer and/or the CEO to develop specific criteria to 
guide the District’s property management decisions. Other water 
agencies or other public agencies with significant property management 
functions (e.g., CalTrans) may be used as examples. This will not only 
ensure that District property is managed consistently, and in a method 
most beneficial to the District, but will also improve the efficiency 
associated with property management decisions through saving District 
staff and Board time and effort (and therefore the overhead cost 
associated with real estate management at the District). 


Finding No. 35 - Opportunity 

Key audit objectives: “Management of real property’ owned by the District and physical assets - 
facilities and infrastructure ” 


Criterion 

The District should have a real estate property management program in 
place to actively manage the properties it owns and to which it has 
access (easements). Such a program should allow the District to readily 
track its real property holdings and their characteristics (e.g., values, 
sizes), as well as allow the District to make timely, informed, and cost- 
effective decisions regarding the disposition of properties it holds but 
no longer uses (see Finding No. 33 above). 

■ Board Policy EL- 7 (Asset Protection) 

■ Baldrige 3.2: Customer Relationships and Satisfaction 

■ Baldrige 4.2: Information and Knowledge Management 

Condition 

Property Management Svstem 

The District’s Real Estate Unit currently has an Oracle database-based 
property management program (“RESPECT”), which it uses to track 
the District’s property holdings. This program allows the District to 
perform its basic property management functions; however, it requires 
excessive quality control and is antiquated in terms of functionality, 
data management speed, and mapping/visual capabilities. The District 
is behind the “state-of-the-practice” among similar agencies and the 
industry at large with respect to its property management information 
management/technology. 

For example, to provide an accurate response to a common and 
relatively simple geographic/property management inquiry (e.g., to find 
out how much right-of-way property the District controls along a given 
creek) would take the Real Estate Unit about a week to answer with 
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Condition 

Board members may submit Board Member Requests and Informal 
Board Member Requests (BMRs/iBMRs) in order to obtain 
clarifying information from District staff. Currently, BMRs and 
iBMRs are tacked in an automated database called “Board 
INFOTRACK” controlled by the Clerk of the Board but the requests 
are tacked by the Office of the CEO and Board Support. District 
staff time spent on BMRs and iBMRs is not formally tracked, 
although auditees consistently report that it is significant enough to 
frequently interfere with staffs ability to perform their day-to-day 
core duties in a timely manner. 

The District’s existing Executive Limitation Policy EL-9 calls for 
the CEO to determine whether BMRs are “non-routine” and would 
“require redirection of District staff to the detriment of their 
normally assigned duties,” and to place such items on the Board’s 
agenda for discussion/approval if those criteria are met. However, 
based on Red Oak’s review of a recent year’s tally of BMRs and 
iBMRs, it appears that many such substantia] requests (e.g., for staff 
to develop a new program or strategy, to perform multiple detailed 
analyses) are made and responded to by staff without having been 
placed on the agenda by the CEO for the full Board’s approval of 
the expected staff effort. Red Oak was also not provided with any 
evidence that indicates the District’s annual budget or unit-specific 
annual budgets are considered or adjusted as a result of BMRs or 
iBMRs that require significant staff time to address. 

In addition, the current BMR/iBMR process offers District Board 
members a potential conduit to circumvent their policy governance 
model by directing staff to implement substantial projects, in 
addition to simply requesting clarifying information. Based on the 
list of recent BMRs and iBMRs provided for Red Oak’s review, this 
has happened on several occasions in the past year (2004-2005). 

Cause 

Although the District has adopted a policy governance model that 
holds the CEO solely responsible for the organization’s 
performance, and necessitates that Board members operate at a 
strategic, policy level, the Board generates a large number of BMRs 
and iBMRs regarding the detailed operations of the District. For 
example, from June 2004 through June of 2005 the Board 
collectively generated 219 BMRs and 209 iBMRs, Of these BMRs 
about Red Oak has estimated that 60% required more than 8 hours 
of work, and of the iBMRs about 65% required more than 8 hours or 
work. 
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Appendix D 


Management of Financial Resources and Financial 

Services Audit Memorandum 















Cause 


Management has emphasized strong accountability and internal control. This 
emphasis is continuously reinforced by annual external audits and 
management letter comments. There has, however, been little emphasis on an 
alignment between the Financial Services Division and the District’s 
operating objectives and Ends policies. 

Recommendation Accounting should develop more detailed (step-by-step) procedures and 
incorporate them into the manual. These step-by-step procedures may exist 
outside the manual as informal procedural documents and notes used by 
staff. 

Debt and Claims should formalize its manual, and add more detailed 
procedures. A more detailed finding in this area follows as Finding 1.0 (b). 

Treasury should complete its manual by adding forms in the Appendix. 

Overall - an overall Financial Services manual reflecting a strategic business 
plan is needed. There are no formal procedures to ensure that Financial 
Services provides information that is aligned with overall operational 
objectives and is sufficient to allow operating staff to measure results in 
financial terms. 


FINDING 1.0(b) -Claims Reimbursement Function 


Criterion 

The District should have a systematic process in place to manage all grant 
and cost-sharing efforts throughout the District. The process should 
incorporate tracking of the entire grant and cost-sharing application process 
and include detailed documentation of the sources and expenditures of grant 
funds to ensure full and accurate reimbursement for District expenditures, as 
well as meet the District’s cost/fund allocation and reporting needs. 


References: 


■ District Board Policy EL-5 

■ Baldrige Criterion 4.2: Information and Knowledge Management 

■ Generally accepted audit standards relating to internal controls 

Condition 

The District participates in a number of grants and cost-sharing partnerships 
across its various business/operational areas. Currently the District’s 
Treasury and Claims Reimbursement Unit, located in the Financial Services 
Division in Administration, processes reimbursement claims for funding 
advanced to projects from District funds. The District typically receives 
reimbursements from cost-sharing efforts and grants at the federal, state, and 
local level, as well as from debt claims. It is common for some of these 
reimbursements to span multiple years. Based on Red Oak’s review of the 
District’s financial services documentation and information provided by 
auditees, the District currently does not have a formal process in place to 
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FINDING 8.1(a) 


Criterion 

GAO Practice 8: Reengineer processes in conjunction with implementing 
new technology. 

GAO Practice 8, Key Point 1. Commercial off-the-shelf software 
packages implemented with limited modification. 

GAO Practice 8, Key Point 2. Processes and controls adapted to fit 
commercial off-the-shelf software. 

GAO Practice 8, Key Point 3. Processes are reengineered across 
functional fields. 

The District should exhibit these GAO Practice characteristics. 

Condition 

The District is using commercial off-the-shelf software, implemented with 
limited modification. The business processes of the District have been 
successfully adapted to fit the new system. Where necessary, processes are 
reengineered across functional fields. However, as stated previously, there is 
very little done in the way of providing financial information in support of 
operational activities. 

Effect 

While basic accounting and transaction processing functions are supported, it 
is difficult for operating managers to obtain information needed to evaluate 
and improve operational efficiency. 

Cause 

Financial Services has no objectives relating to this area. 

Recommendation 

The District should continue with the current approach and, where possible, 
as the system is expanded, include enterprise performance measurement and 
reporting and the relation of financial and operating information. 


GAO Practice 9; Translate financial data into meaningful information. 

Key Audit Scope Elements 

a) Fee and rate-setting 

b) Capital projects financing 

c) Indirect cost management and allocations 

Key Benchmark Characteristics 

1. Reports are designed around key drivers such as markets, products, and 
customers. 

2. Relevant financial information is presented in an understandable, simple format 
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The District is also to be commended for its recent critical review of its long¬ 
term water supply situation conducted by the Water Supply Sustainability 
Planning Unit—a good example of ownership and follow-through from the 
IWRP, and of self-examination of a core business function across 
organizational boundaries. This analysis, for example, considers possible 
future delivery changes from SFPUC to the District’s customers. The District 
is also to be commended for its association of water use efficiency with 
energy savings and air quality improvements in its annual Water Use 
Efficiency report, as well as its consideration of the implications of climate 
change on long-term water supplies and the District’s planning as noted in the 
IWRP and the District’s examination of its long-term water supply 
sustainability. 

The Water Supply Sustainability Planning Unit study also suggested the need 
for ongoing attention to the human resources dedicated to the (1) imported 
water and (2) groundwater management functions in the WUE, the District’s 
two most important water supply resources noted in the IWRP. Like the topic 
of asset management addressed elsewhere in this memorandum, detailed 
staffing level assessments are beyond the scope of this performance audit; 
however, the attention paid to these two areas by existing in-house studies of 
future business needs versus current staffing levels indicates the need for the 
District to proceed with more closely aligning staffing levels with business 
needs on a District-wide basis. Long-term dedication of resources to these 
areas was raised by multiple auditees, and is also a factor in the District’s 
Imported Water Program Plan. 

The WUE’s Business Plan is very clear regarding the functions and staffing of 
each unit in the WUE. However, in one or more areas, District staff and Board 
members are engaged on the same topic at different levels, often with external 
stakeholders, and without a clear mechanism for coordination, based on 
documents provided to Red Oak for review. The District may want to develop 
“roles and responsibilities” tables for areas like imported water, where the 
Imported Water Unit, a senior project manager in the WUE, and one or more 
Board Members are involved in the topic to various degrees, to realize the full 
benefit of its varied activities. The District’s Imported Water Communication 
Plan indicates that staff is in a “reactive” role with respect to what Board 
members do externally with respect to the District’s imported water. 


The District has historically developed its WUE organization in alignment 
with the increasingly complex nature of water management, including 
imported water management, groundwater quantity and quality management, 
water use efficiency, and other functions to enable it to comprehensively 
manage the County’s water supply per its mission. It has continued to 
diversify and examine its water supply portfolio and its key water supply 
functions across organizational boundaries. 
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and capital planning and management. 


The key audit objectives for the CPS audit provided to Red Oak by the District were as follows, 
as indicated in Task 3.6 of the scope of work: 


“Assess the effectiveness and efficiency of: 

A. Management of the capital program 

B. District oversight of consultants and contractors 

C. District quality assurance procedures used to prevent or detect errors and omissions in 
preparing capital project planning and design specifications, contracts, and purchasing 
documents 

D. Operational policies and procedures 

E. Compliance with State and Federal regulations ” 


The fieldwork for the CPS audit consisted of the following components: 

• Document reviews 

• Individual interviews with the following: 

o Chief Operating Officer (COO) 
o Deputy Operating Officer (DOO) 

o Assistant Operating Officers (AOOs) of the Watershed Management Capital 
Program, the Water Utility Management Capital Program, and the Technical 
Services Program 
o All Unit Managers within CPS 

« Questionnaires completed by CPS’s COO, DOO, AOOs, Unit Managers, and Senior 
Project Managers 

Following the fieldwork and preparation of preliminary versions of the findings presented in this 
memorandum, Red Oak (1) validated the preliminary findings with the staff listed above, (2) 
presented the findings and recommendations to the Audit Committee on July 25, 2006, and (3) 
validated the draft version of this memorandum with the COO. This final memorandum 
incorporates input provided to Red Oak during all these steps. 

Per the scope of work, the Comprehensive Performance Audit was an objective and independent 
evaluation of the Board of Directors’ (Board) compliance with their Governance Policies, and 
the Chief Executive Officer’s implementation of the Board’s Ends and Executive Limitation 
Policies. To that end, the audit scope was broad (Distinct-wide), but necessarily limited to the 
most important topics to the District as a whole. Therefore, these memoranda generally do not 
contain exhaustive assessments of any District work unit or work process. 

Red Oak maintained the focus on the District’s key issues through the systematic audit 
methodology outlined in the scope of work, which included the establishment of performance 
audit criteria per GAGAS and as demonstrated in the Findings section of this memorandum. 
Additionally, in accordance with GAGAS, Red Oak’s project management team and audit 
leaders used their professional judgment to focus the audit on material findings and 
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project in question. 

Effect 

There is no systematic process for the consideration of value engineering or 
similar smaller-scale efforts in the design phase of the District’s projects. 
This represents missed opportunities for the District to incorporate the 
specific examination of multiple “value propositions” for a given project at 
the design phase. 

Recommendation 

As part of the capital project design process, criteria for an appropriate level 
of peer review or value engineering should be in place and documented for 
each project. It is likely that many projects are not amenable to an industry- 
standard “full-scale” value engineering approach; however, Red Oak’s 
experience is that most of the District’s projects are of the size and 
complexity that would benefit from a smaller-scale peer review, from a 
quality basis, a cost basis, or perhaps both. In any case, the consideration of a 
value engineering, peer review, or alternative outside expert review process 
should be considered for every District project. Red Oak appreciates that 
fully implementing this recommendation may require that CPS work with 
Procurement and/or the CEO and Board to streamline the approval and 
procurement process for this type of work, similar to the “Strength No. 5” 
recommendation in this memorandum. 


Capital Program Services Opportunity Finding No. 4 

Key Audit Objectives: “District oversight of consultants and contractors 


Criterion 

CPS should have internal polices for measuring and managing the 
performance of consultants. 

References: 

o Baldrige Criterion 6.2.a.4: Control and improvement of support 
processes 

Condition 

CPS requires consultants to provide regular reports to project managers on 
their projects. The design process outlines the additional steps required to 
handle a project when consultants are involved. However, the District applies 
an open-ended, relatively subjective tool for use by project managers in 
evaluating their consultant’s performance. These evaluations are submitted to 
the District’s Contract Administration group, and their lack of objective 
criteria limit their usefulness in determining whether to engage each 
consultant in future services. In addition, consultant performance evaluations 
are requested and completed on a periodic basis, which may or may not 
coincide with key milestones or completion points of consultant 
engagements. 

Cause 

CPS recognizes that consultants must adhere to scopes, budgets, and 
schedules, but has not applied a consistent standard across consultant 
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• Select critical criteria for audit 

• Establish appropriate timeframe to be audited 

• Determine how the condition will be measured for comparison to 
criteria and how conclusions will be validated with District 
representatives 

• Prepare audit instruments and detailed work plan 

• Conduct internal and client review, revise 



3.3.2.4 Conduct audit fieldwork/deskwork 

• Conduct 4 additional interviews 

• . Review key product, service, and business processes 

• Review existing performance measures and targets 

• Evaluate how overall costs are minimized and how defects and 
delays are prevented 

• Evaluate how processes are improved 

• Evaluate cost minimization procedures associated with inspections, 
tests, and performance audits 

• For the Budget and Finance Unit, review reserve policy, 
specifically, per items 2.a.v.l through 2.a.v.l0 of District 
“Statement of Work” provided with RFP 

• Review the District’s budget process and (decentralized) 
management and staff involvement 

• For the Contracts and Procurement Services and Procurement and 
Inventory Management Units, review policies, compliance, 
inventory management, cost information, and inventory ordering 
and delivery systems. 

• Review District’s overhead rate, and indirect cost allocations 
supporting that rate, to determine whether reasonable and 
appropriate assumptions and cost allocation principles are 
employed 

• Assess the District’s compliance with Prop. 218 

• Execute other specific audit tasks and draft findings for each 

• Review findings in field with those directly involved, if possible, 
and document feedback 


Prpfge^ 


$46,258 


3.3.2.5 Prepare memorandum of findings 

• Prepare draft for internal team review, including specific 
recommendations on how the District can best maintain its 
reserves for local use in compliance with Governmental 
Accounting Standards 


APPENDIX ONE - SCOPE OF SERVICES 
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Deliverables: 1 preliminary draft and 1 final draft 
memorandum of findings, delivered electronically 


Progress Milestone 3.3.6 • / ,$2.1,150 


3.3.7 Real Estate 

3.3.7.1 Develop plan and schedule for background research 

3.3.7.2 Conduct background research 

• Review documents, including business planning (goals, objectives, 
approaches, action plans, etc), policies and procedures, workload 
and performance statistics, and organizational “charter” 

3.3.7.3 Develop audit approach 

» Identify potential audit criteria, including Carver model, Baldrige 
criteria, State and Federal law, and funding source requirements 

• Select critical criteria for audit 

• Establish appropriate timeframe to be audited 

• Determine how the condition will be measured for comparison to 
criteria and how conclusions will be validated with District 
representatives 

• Prepare audit instruments and detailed work plan 

• Conduct internal and client review, revise ' 

3.3.7.4 Conduct audit fieldwork/deskwork 

• Conduct 2 interviews 

• Assess District generation of revenue from its properties and 
management and allocation of that revenue 

• Execute other specific audit tasks and draft findings for each 

• Review findings in field with those directly involved, if possible, 
and document feedback 

33.1.5 Prepare memorandum of findings 

9 Prepare draft for internal team review 

• Revise and review with appropriate client representatives 
(validation meeting) 

9 Finalize memorandum of findings 

Task 3.3.7 Assumptions 

Meetings: 1 total (1 validation meeting) 


APPENDIX ONE - SCOPE OF SERVICES 
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Section 3 

Project Goal, Scope, and Methodology 


3.5. Findings Development and Validation 


Red Oak developed audit findings based on the fieldwork described earlier in this section. 
These findings are presented in the memoranda attached according to the GAGAS findings 
structure and are designated as either “Strengths” (positive findings, in some cases with 
relatively minor recommendations for continuous improvement/optimization) or 
“Opportunities for Improvement” (findings with more significant associated 
recommendations for improvement). The District’s key audit objectives to which each 
finding most directly relates were also indicated. 

Following the fieldwork and preparation of an internal draft version of each interim audit 
memorandum, Red Oak validated the preliminary findings verbally with auditees to 
ensure their factual accuracy and relevance and, where appropriate, provided auditees 
with excerpts from each draft memorandum pertinent to their area(s) of responsibility for 
review. Red Oak incorporated information from these preliminary validation meetings and 
presented a summary of this memorandum to the respective Chief Administrative or 
Operating Officer. In each case, Red Oak incorporated input from this step and submitted 
the interim audit memorandum appended to this report. The involvement of the Audit 
Committee throughout this process is discussed below. This final audit report incorporates 
input provided to Red Oak during all of the above steps and is the culmination of Red 
Oak’s submittal of the following interim audit memoranda during the project: 

® Board of Directors Audit Memorandum 

® CEO Office Interim Audit Memorandum, including Review of SCVWD 
Performance Measurement Program Memorandum 

• Administration Interim Audit Memorandum 

• Financial Services Division Interim Audit Memorandum 

• Watershed Operations Interim Audit Memorandum 

• Water Utility Enterprise Interim Audit Memorandum 

® Capital Program Services Interim Audit Memorandum 


3.6. Audit Committee 


Prior to Red Oak’s commencement of this audit, the District’s Board of Directors 
established an Audit Committee consisting of three Board members and four 
community/stakeholder representatives to oversee this performance audit. The members of 
the Audit Committee are listed in the Acknowledgements section of this report. During the 
course of this project, Red Oak presented to the Audit Committee and engaged in 
discussion regarding interim audit findings at key milestones as follows. In addition, the 
Red Oak and District project management teams met throughout this audit, beginning 
with the June 9, 2005, kickoff meeting. 
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Section 3 

Project Goal, Scope, and Methodology 


It is important to recognize that these remarks are based on the Red Oak team’s Please 
note that these remarks are based on the Red Oak team’s collective knowledge of industry 
standard practices and best practices, and are not the result of any agency peer research 
efforts conducted specifically for this audit. 

3.8.1 Metric Benchmarking 


In metric (quantitative) benchmarking, one organization’s costs or other numerical values, 
such as performance measurements, are compared with the corresponding values of other 
organizations. Metric benchmarks do not, by themselves, identify how to improve a 
process or increase efficiency. Rather, they are numerical parameters that measure the 
performance of a specific entity. Confusion may arise because of pressure to use 
performance benchmarks to compare efficiencies among different entities. However, since 
each entity has its own unique set of controlling variables, direct comparisons may be 
inaccurate and are often misleading. Considerable effort is required to account for these 
variables so that equivalent and fair comparisons can be made. In many cases, useful 
comparisons still cannot be made despite all attempts to account for variables or otherwise 
“normalize” an organization’s quantitative performance results. 

Many types of control variables must be accounted for when attempting to normalize 
metric performance data for comparison among public agencies, including: differences in 
debt service; cost of living; regulatory requirements; type and magnitude of technologies 
employed; economies of scale; customer base; geographic considerations; operations and 
maintenance practices; and asset/infrastructure differences. Unfortunately, “un¬ 
normalized” comparison performance data are frequently used within the public sector, 
unlike the private sector, where processes typically are not compared until all control 
variables are accounted for. In fact, comparing entities based on metric performance data 
alone is generally not advised due to the significant potential for misuse, incorrect 
interpretation, and unreliable data. Instead, metric performance benchmarks are best used 
for internal purposes to track improvements, and in concert with process benchmarking, 
as opposed to being used as a primary means to compare one’s agency with external 
entities. 

3.8.2. Process Benchmarking 

Process benchmarking is typically a far better way to apply benchmarking efforts in the 
public arena, as it focuses on improving internal programs and processes by learning how 
“the best” organizations conduct such activities. In process benchmarking, an agency’s 
governance and leadership practices, management approach, procedures, and systems are 
compared to recognized industry best practices. With this focus, benchmarking is not 
limited by the need to fully account for control variables that affect metric benchmarking 
outcomes, which might not be practical. Comparing practices and procedures, such as one 
entity’s customer complaint response mechanism to another’s, helps identify better 
methods and procedures of conducting business that an agency can use to develop 
improved processes over the long term. 
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Section 10 

Baldrige Category 4 - Measurement, Analysis, and Knowledge Management 


management across the agency. Red Oak found that efforts to establish and implement an 
agency-wide performance measurement system have been hampered somewhat by the 
historic lack of an agency-wide strategic plan and the unit-by-unit manner in which most 
of the District’s existing performance measures have been developed. This is discussed in 
detail in the CEO audit memorandum and its attachment appended to this report, and also 
relates to the Baldrige Item 4.1 noted above. In brief, the benefits of agency-wide 
performance measurement are limited if a clear, specific agency-wide plan is not in place. 
Ideally, the two go hand-in-hand—the performance measurement program should be 
directly measuring the agency’s progress against its strategic plan. This is another area 
where the District has made advancements since the time of Red Oak’s audit fieldwork, 
for example, with explicitly linking budgeted items to Ends Policies in the FY 06-07 
budget, and with development of the “CEO Work Plan” and associated performance 
metrics. 


The District is to be commended for being among one of the leading agencies with respect 
to Water Utility Enterprise performance measurement and management; it is a “Founding 
Utility Participant” of AWWA’s “QualServe” benchmarking program and auditees report 
sharing benchmarks with similar agencies such as EBMUD and Zone 7 Water Agency. 
This audit finding relates to the District making the most of this expertise in performance 
measurement and management in the Water Utility Enterprise by ensuring internal 
consistency and clarity, and subsequent coordination with agency-wide performance 
management efforts. 

The District has historically taken a proactive role in many areas of water resources 
management such as those listed above, which is commendable. It is likely that many 
performance objectives and measures have been in place within the Water Utility 
Enterprise before any attempt by the District at agency-wide performance measurement, in 
part due to the Water Utility Enterprise’s activity in QualServe and/or other measurement 
efforts as noted above. Red Oak also understands that most of the performance measures 
in place throughout Water Utility Enterprise and the rest of the District were developed 
independently on a unit-by-unit basis. As indicated in Red Oak’s appended audit 
memorandum addressing the CEO offices of the District, the District is underway with an 
ambitious effort to standardize, simplify, and consolidate performance measurement 
District-wide. 

Performance measures currently tracked for Watershed Operations tend to be very 
quantitative and are very useful to evaluate cost-effectiveness or other numeric values 
relating to project delivery. However, qualitative measures relating to tracking cause-and- 
effect accomplishments or demonstrating that creative or innovative methods are 
encouraged and desirable can be difficult to understand using current measures. As above, 
more details on this topic are included in the audit memoranda attached. 

The clarity, consistency, and level of specificity of the District’s objectives in many of its 
core service areas are mixed. Specifically, some objectives are measurable, or have 
associated CEO Interpretations that are measurable, while others are not. Furthermore, 
the relationships between the various sets of objectives and metrics for a given unit or 
given function are generally unclear. For example, although Water Utility Enterprise is one 
of the leaders within the District with respect to business planning and performance 
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Section 12 

Baldrige Category 6 - Process Management 


Red Oak was not able to determine whether this is the case. Regardless, the situation as 
described can lead to delays and cost increases, as operating group personnel may be 
required to resubmit requests to Administration, and both sides spend time debating the 
Board’s/CEO’s intent behind the policy and their respective interpretations in addition to 
time spent executing the transaction of concern. 

A recommendation made in the appended Chief Executive Offices interim audit 
memorandum and earlier in this summary report applies directly to this issue of policy and 
procedure clarification as well. Specifically, in accordance with the District’s policy 
governance model, the CEO should develop clear and specific interpretations for all of the 
Board’s policies and identify what entity is responsible for enforcement of these policies. 
The CEO should ensure they are communicated to his Executive Leadership Team and/or 
Division managers for dissemination to the unit managers and other line staff charged 
with implementing them on a day-to-day basis. 

This may be achieved by executive decision/action on some policies and as the result of 
focused dialogue in other areas, at the CEO’s discretion. Implementation of policies and 
procedures has the greatest chance of success when the policy is clear and non-debatable 
when compared to policies that are left to Administration and/or operating staff to 
interpret. 


12.2. Procedure Standardization 


The District is to be commended for striving for standardization of its procedures across 
its organization. The District has chosen to pursue International Standards Organization 
(ISO) compliance for this effort across its organization. However, like a number of other 
undertakings noted in this report, it has been implemented in a piecemeal fashion and was 
still a work in progress at the time of Red Oak’s audit fieldwork. Not only would District¬ 
wide ISO certification help ensure organization of policies and procedures and continuous 
improvement of these processes, it would also add structure to link policies between major 
departments at the District. It is important to note that the ISO format is not necessarily 
the only or the optimal framework by which the District can achieve standardization of its 
procedures; however, the District has made a significant investment in doing so to date 
and is on track to complete standardization with ISO as the basis. Easier policy and 
procedure interfaces between operating groups at the District would facilitate interaction 
and coordination between groups. 

The District has taken a number of important steps with respect to documenting operating 
procedures, including the following: 

• Achieving the International Standards Organization (ISO) 9001 and 14001 
certification in Watershed Operations, and 9001 in Capital Program Services. 

• Developing a thorough set of ISO procedures and measures. 

• Exhibiting a high degree of consistency between work processes described by 
interviewees and written procedures. 
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leaders used their professional judgment to focus the audit on material findings and 
recommendations designed to yield the greatest potential benefit to the District. 

Overview of Audited Organization 

The District’s Board of Directors consists of seven members, five of whom are elected to 
represent a specific geographic jurisdiction within Santa Clara County (County) and two of 
whom represent the District “at-large” and are appointed by the Santa Clara County Board of 
Supervisors. One at-large member represents North County, consisting of San Jose and its 
greater metropolitan area including Morgan Hill, and the other at-large member represents South 
County, which contains areas that were within the 1967 Gavilan Water Conservation District 
boundaries, including the San Martin and Gilroy areas. According to the District’s policy 
governance model, the Board’s primary responsibilities consist of establishing policies relating 
to “Ends” (organizational products), “Executive Limitations” (constraints on executive 
authority), and the “Governance Process” (specifications for Board processes and operations). In 
addition, the Board is responsible for evaluating the performance of the Chief Executive Officer 
(CEO), whose individual performance is understood to be representative of the District’s 
performance under the policy governance model. 

Red Oak was informed by the District during the finalization of this audit report and memoranda 
that, effective January 1, 2007, the District will be transitioning to a five-member Board of 
Directors. This change is a component of the legislative action instigated and finalized during the 
course of this audit that will enable the District to approve its own annual budget without the 
additional approval of the Santa Clara County Board of Supervisors. This memorandum reflects 
the composition of the Board of Directors at the time of Red Oak’s primary audit fieldwork for 
the Board audit (August - October 2005). 

Exhibit 1 presents the Board of Directors and their tenure. Information presented reflects the 
mid-2005 time period of the Board of Directors audit fieldwork and preparation of this audit 
memorandum. 


Exhibit 1 


Director 

District 

Tenure 

Rosemary Kamei 

1 

12 years (since 1993) 

Joe Judge 

2 

19 years (since 1986) 

Richard P, Santos (Chair) 

3 

5 years (since 2000) 

Larry Wilson (Vice-Chair) 

4 

11 years (since 1994) 

Gregory A. Zlotnick 

5 

9 years (since 1996) 

Tony Estremera 

At-Large (North County) 

9 years (since 1996) 

Sig Sanchez 

At-Large (South County) 

25 years (since 1980) 


Source: Santa Clara Valley Water District, 2005 
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AUDIT memorandum: 


To: Alison Russell, Project Manager, Santa Clara Valley Water District 

Peter Sakai, Contract Manager, Santa Clara Valley Water District 
Larry Wilson, Audit Committee Chair 

From: Tom Arn, Project Officer 

Robert Lockridge, Chief Executive Offices Audit Leader 

Date: October 11, 2006 

Re: Comprehensive Performance Audit - Interim Audit Memorandum 

Task 3.2 - Chief Executive Offices 


This memorandum presents Red Oak Consulting’s (Red Oak) findings documenting the results 
of our audit of the Santa Clara Valley Water District’s (District) Chief Executive Offices. Red 
Oak performed this audit as a component of its Comprehensive Performance Audit of the 
District. This memorandum represents completion of Task 3.2 of Red Oak’s Agreement No. 
A2921A with the District. 

Introduction 

The District contracted with Red Oak to conduct a performance audit of the District. The audit 
fieldwork and this series of memoranda were structured according to the District’s organization, 
using a “top-down” approach beginning with the Board of Directors. Red Oak and the District 
recognized that many audit findings and recommendations would involve one or more 
organizational units. Therefore, these memoranda were initially presented as interim, preliminary 
drafts and remained so until the completion of the audit. Upon completion of all audit fieldwork, 
Red Oak finalized the interim findings/recommendations presented in this and the other draft 
memoranda. Therefore, this memorandum is to be considered as one component of Red Oak’s 
final audit report to the District. 

Objectives, Scope, and Methodology 

Red Oak conducted the Comprehensive Performance Audit according to Generally Accepted 
Government Auditing Standards (GAGAS). As a result, this memorandum was prepared in 
accordance with the GAGAS Reporting Standards for Performance Audits (USGAO, 2003). 
Additionally, per the scope of work, Red Oak’s audit included a review of systems and processes 
for internal controls; examination of documents and records; interviews with staff, customers, 
and stakeholders necessary to evaluate the District’s compliance with applicable laws, 
regulations, and policies; and evaluation of the effectiveness and efficiencies of the District’s 
policies, procedures, and practices for financial, administrative, and operational management, 
and capital planning and management. 






Cause 

The District has engaged in a wide range of governmental relations activities, 
but generally has not yet measured its effectiveness in conducting these 
activities, that is, in terms of direct, quantifiable benefits to the District (e.g., 
funding secured, grants awarded, legislation passed). 

Effect 

Although the District is active at all levels of government, the District does 
not yet have the necessary feedback from its activities to determine whether 
its governmental activities are adequate or properly focused. 

Recommendation 

The District should revisit its set of performance measures for its 
governmental relations activities. The set should reflect a higher ratio of 
results-based measures to activity-based measures so that they will yield 
feedback that is more useful for the District. If the District has not already 
done so, it should determine which, if any, of its current governmental 
relations efforts could be more effectively or efficiently performed through 
an organization such as the Association of California Water Agencies 
(ACWA) or the American Water Works Association (AWWA), and which 
activities are best carried out by the District. 


Finding No. 7 - Opportunity 


Criterion 

The mission of each District department/work unit should be clear and 
explicit, and directly support the mission of the District as a whole. In terms 
of the functions of the CEO offices, the District should have a mission 
objective related to its communication with external entities, and the Office 
of Communications (and other departments/units as appropriate) should 
directly support that mission objective. Additionally, in most cases 
(particularly on high-profile or sensitive topics), it is appropriate for the 
Office of Communications to be the focal point for information delivered to 
entities external to the District. 

Reference: 

° Baldrige Senior Leadership: l.la(l) 

o Baldrige Strategy Development: 2.1a(l) and 2.1b(l) 

Condition 

The District is to be commended for having an established Office of 
Communications staffed with experienced professionals. However, the 
Office of Communications currently has no vision/mission statement, and is 
unclear on the Board/CEO’s direction as to whether the Office should be 
highly active in terms of public information and making the District a high- 
visibility agency, or strive to maintain a lower public profile. Additionally, 
the District has not utilized this office to its full potential for identification 
and relationship-building efforts with key customer groups. Furthermore, the 
Office of Communications does not appear to be used by all District 
departments/units for significant external communications from the District 
to its stakeholders. If not closely coordinated, this can lead to parallel and 
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ATTACHMENT A 


To: Peter Sakai, Santa Clara Valley Water District 

From: Rebecca Dybas, Red Oak Consulting 

Todd Anderson, Red Oak Consulting 

Date: September 9, 2005 

Re: Comprehensive Performance Audit - Review of Santa Clara Valley Water 

District’s Performance Measurement Program 


This presents Red Oak Consulting’s (Red Oak) review of the Santa Clara Valley Water 
District’s (District) performance measurement program. Red Oak performed this review 
as a component of its Comprehensive Performance Audit of the District. This 
memorandum represents completion of Task 2.3 of Red Oak’s Agreement No. A2921A 
with the District. 

Introduction 

The District has contracted with Red Oak to conduct a comprehensive performance audit 
of their organization, including a review of the District’s performance measurement 
system. The District, through its Office of Performance Excellence, has made numerous 
advances in its performance measurement system in recent years, including working to 
reconfigure the system to align with the Malcolm Baldrige National Quality Program 
(Baldrige) Criteria. Per Red Oak’s scope of work, this provides “a brief memorandum 
summarizing the existing District performance management process, identifying any 
significant gaps noted and providing any recommendations.” 

Methodology 

Red Oak conducted this review through document reviews, conversations with Office of 
Performance Excellence staff, and collecting feedback on the District’s performance 
measurement efforts from executive managers at the District. Specifically, Red Oak: 

1. Discussed the existing performance measurement program during a meeting with 
Mr. Peter Sakai, the Chief of the Office of Performance Excellence, following the 
audit’s June 9, 2005 kickoff meeting. 










they provide based on customer feedback. This provides an 
excellent foundation on which to build more systematic, measurable 
customer feedback measures to demonstrate improved service over 
time. Key administrative areas such as training, reprographics, and 
reception are particularly amenable for structured customer feedback 
measurement and process improvement over time. Any customer 
feedback processes must be conducted within the context of the 
organization’s objectives and policies and understood fully by the 
participants; otherwise, they can devolve into open-ended 
“complaint” forums or vehicles for customers to ask for 
unreasonable levels of service. Red Oak understands that the District 
is already underway with an Administration-wide customer feedback 
mechanism to build upon its existing collection of unit-specific 
efforts. 


Finding No. 3 - Strength 
Key audit objective: N/A 


Criterion 

The District should periodically consider alternative methods (e.g., 
consolidating or eliminating work units, outsourcing non-core 
support services) in order to achieve level-of-service improvements, 
cost savings, or both. 


References: 

• Baldrige — 2.1: Strategy Development 

• Baldrige -6.2: Support Processes and Operational Planning 

• Baldrige -7.3: Financial and Market Results 

Condition 

The District has demonstrated it is open to evaluating and, if 
appropriate, implementing alternative provision of support services 
historically performed in-house. For example, during 2005, the 
Equipment Management Unit evaluated the possibility of 
outsourcing its auto parts function, which supports the District’s 
vehicle fleets. They currently have published a request for proposals 
for an auto-parts vendor that would be on-site 8 hours a day to 
manage and stock the auto parts section of the District warehouse. 
According to a cost/benefit analysis completed by the Equipment 
Management Unit, the District could save up to $100,000 a year 
through this potential outsourcing arrangement. 


Furthermore, the Administrative Services Division performed 
detailed analysis of using outside vendors for reprographics services 
and found that using in-house resources was more economical in 
terms of timeliness and cost-effectiveness. 


Red Oak recognizes that evaluating and possibly implementing 
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losses. According to EL-7.2, the CEO is required to “maintain District 
Self-Insured Risk Retention for liability at $2 million.” It is unclear 
whether this retention requirement is $2 million per occurrence, per 
annual total, or per cumulative retention. Such a rigid retention 
requirement does not enable the District to take advantage of the 
realities of the insurance market. 

Specifically, when prices are low and coverage is available (a so-called 
“soft” market), the District may be better served by purchasing 
coverage with lower self-insured retentions. Under some conditions, 
there may be little cost difference between what are relatively large 
differences in coverage. Best-practice insurance purchasing calls for 
the insured to take advantage of favorable market conditions. That 
requires flexibility for those making purchasing decisions. Conversely, 
when market conditions are poor for the insured (a so-called “hard” 
market), the District should have the flexibility to increase retentions to 
keep costs in line. 


Finding No. 15 - Opportunity 

Key audit objectives: “Risk management/insurance costs 


Criterion 

Claim files should be audited periodically by independent outside 
authorities to assure proper handling and reserving practices. 

References: 

• Board Policy EL- 7: Asset Protection 

• GASB Statement No. 10 

Condition 

The District’s workers’ compensation claims are subject to a formal 
audit process every two years. Liability claims, far fewer in number, 
are not formally audited by outside sources. These claims are 
administered internally and case reserves are set by the Risk 
Management Administrator (RMA) in conjunction with District legal 
counsel. 

Cause 

Workers’ compensation claim audits are the result of a decision by 
District staff to follow this procedure. The decision not to obtain 
formal audits of liability claims is one made jointly based on the 
opinions of the RMA and legal counsel that claims are too few in 
number for such a procedure and that results of the current system 
have been successful. 

Effect 

Claim audits provide a means to verify handling procedures and to 
obtain an independent opinion regarding the adequacy and accuracy of 
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interface with customers and solicit feedback. 


pi 


The IMD uses root-cause analysis to identify and resolve the key 
contributing factors related to major IT issues. 


Cause 

The IMD has specifically delegated help-desk support to a dedicated unit and 
provided a budget for the acquisition of a service management tool. 

: '\ 

(§1 

Effect 

The Information Technology Unit is focused on customer service and has 
successfully provided a help desk for users to report issues. Generally, there 
is a high level of satisfaction with the help desk within the District. The 
usage of “account managers” has contributed much to this success, and 
appears to be a valuable tool that other support service units may want to 
employ to solicit customer feedback in addition to, or instead of, customer 
surveys, 

k| 


The use of automated tools to manage service requests allows the unit to 
track their performance in providing support, report on frequent problems for 
further investigation, and assure that every request is assigned a responsible 
party to assure resolution. 


Finding No. 26 - Strength 

Key audit objective: “Information management” 


Criterion 

The District should have a permanent, official structure for information 
technology (IT) governance, with authority to assess proposed IT initiatives, 
make/recommend IT investment decisions, and track/review progress of 
current initiatives. 

References: 

• Baldrige - 4.2a (4): Information and Knowledge Management 

Condition 

The District’s Information Systems Steering Committee (ISSC) meets 
quarterly, or as-needed, to discuss proposed IT initiatives and make IT 
investment decisions. ISSC members are regularly updated with formal 
status reports during major IT project executions. 

Cause 

The IMD and other District senior managers formed the ISSC, whose 
primary purpose is to determine the merit of new projects. The ISSC’s 
secondary function is to periodically review the status of major projects. 

Effect 

The District is able to maintain high-level control of projects with senior 
managers involved in the decision making process. 
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with other organizations. 

Other organizational units which fall under the “financial management” scope of work for the 
audit are: 

• Contracts and procurement administration, and 
® Risk management/insurance. 

Both of these units are located in the General Services Division of Administration and were 
audited as part of the Administration audit. Findings are included in the memorandum for that 
audit. 

Audit Approach and Findings 

In accordance with GAGAS, Red Oak established audit criteria for Financial Services based on 
the following sources, to meet each of the audit objectives in the scope of work and cited above: 

Primary Criteria 


■ General Accounting Office (GAO), “Executive Guide - Creating Value through World- 
class Financial Management” (April 2000) (General framework for evaluation) 

m Baldrige National Quality Program, “Criteria for Performance Excellence” (2005) 
(General framework - supplements the GAO framework) 

■ Fitch Ratings, “The 12 Habits of Highly Successful Finance Officers”, Public Finance 
(November 21, 2002) (Representative of creditors’ perspective) 

■ Government Finance Officers Association (GFOA), Recommended Practices (specific 
technical “best practices ” for government finance functions - includes financial 
reporting and budget awards programs) 

■ Board Policies and CEO interpretations (internal requirements - considered as a 
“condition ” in relation to external criteria as well as criteria for internal compliance) 

Other Selected Criteria 


■ Generally accepted accounting principles applicable to government as promulgated by 
the Governmental Accounting Standards Board (GASB) and its predecessor standard¬ 
setting bodies 

B GASB publications relating to performance measurement and reporting 

■ International City/County Management Association (ICMA) publications relating to best 
practices in public sector management applicable to finance 
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Condition 

The District has adopted clear reserve policies which are published in its 
budget document. These policies provide for appropriate restriction of 
resources and a reasonable and prudent level of discretionary reserves, given 
the District’s financial circumstances. The $3-million working capital reserve 
in the Water Utility Enterprise is at the low end of best practices. 


The District has a practice of appropriating funds for capital projects for 
which contracts have not been executed. This could lead to a 
misunderstanding of the District’s ability to change its spending plans over 
the long term. 


An analysis of actual losses in comparison to insurance reserves indicates 
that reserves have in the past far exceeded requirements. 

Effect 

Substantively, the District has established prudent and adequate reserves in 
most respects. Failure to clearly justify and explain reserve policies has 
resulted in some criticism from stakeholders. 

Cause 

Board policies and CEO interpretations do not clearly provide guidance to 
staff so that reserves are appropriately established, justified, and explained to 
stakeholders. 
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FINDING 1.0(d) - Budget policies and procedures 


Criterion 

The budget is the core business process of a government entity, providing a 
plan for legally appropriating and expending community resources for 
specified ends. The GFOA has developed extensive criteria for government 
budgeting, reflected in the checklists for its Distinguished Budget 
Presentation Award. 

Because of its importance, a governmental budget process should facilitate 
clear, thoughtful planning of activities and expenditures by staff and provide 
an understandable document for consideration and approval by elected 
officials. 

The District’s budget should reflect these criteria and characteristics. 

Condition 

The District’s budget policies and procedures are well written, reflect Board 
policies and the District’s business objectives, and are reiterated in the 
budget document. There is no provision for specific procedures related to the 
District’s annual submittal of its budget to Santa Clara County for approval. 

The budget process used by the District is complete and reflects best 
practices, providing appropriate information at the right levels for budget 
preparation, review, and subsequent monitoring and revision. The omission 
of substantive procedures for the Santa Clara County approval step is 
significant and has resulted in some conflict. Specifically, a review of the 
District’s budget submittal by the County’s Management Audit Division 
(SCC/MAD) was critical of the quality of information provided and the 
timetable available for review. 

The District has adopted a governance structure based on the “Carver Policy 
Governance Model.” This model makes a very clear differentiation between 
the responsibility of the Board to establish policy and the responsibility of 
the CEO to execute that policy. SCC/MAD has correctly pointed out that 
“the SCVWD Board of Directors has granted broad administrative authority 
to the Chief Executive Officer (CEO) to manage the District’s operations and 
capital programs...[and that]...core budget review and oversight duties 
typically retained by governing boards in other public jurisdictions have also 
been delegated to the CEO.” Finally, SCC/MAD concludes that “the 
Directors and the Board of Supervisors have relinquished considerable 
budgetary control authority to staff. This could expose the District Board of 
Directors and Board of Supervisors to substantial risk.” 

In Red Oak’s opinion, these observations and conclusions reflect the 
assumption that the common local government paradigm is correct. The 
Carver model was developed as a corrective for the perceived inability of 
nonprofit and public-sector institutions to focus on results and efficiently 
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FINDING 1.1(a) 

Basic Financial Accountability and Fiduciary Responsibility 

Criterion 

GAO Practice 1: Build a foundation of control and accountability that 
supports external reporting and performance management. 

GAO Practice 1, Key Point 1. The financial reporting and audit process is 
a basic management and oversight tool. 

GAO Practice 1, Key Point 2. Accountability is part of the organizational 
culture and goes well beyond receiving an unqualified audit opinion. 

The District should exhibit these GAO Practice characteristics. 

Condition 

The District consistently receives GFOA awards for its Comprehensive 
Annual Financial Report and budget document. In addition, it consistently 
receives unqualified audit opinions. 

No material management letter findings were identified. Auditor comments 
receive priority attention and are quickly cleared. There is a high level of 
linkage between the budget and organizational goals, plans, and policies. 

Effect 

A solid basis for continuing financial accountability and fiduciary 
responsibility has been established. 

Cause 

The Board and CEO are highly aware of the importance of financial 
management, policy governance and accountability. Written Board policies 
reinforce this. 

Recommendation 

Board policies in this area are very general. While this is appropriate given 
the governance model adopted by the District, line managers are sometimes 
unsure of the specific intent of the policies in operational terms, and would 
benefit from more detailed CEO interpretations. Line managers should 
recommend alternative interpretations, and/or engage in focused dialogue 
with the CEO as necessary as noted in other audit memoranda. There should 
be no Board policy without a CEO interpretation. 

FINDING 1.2(a) - 

Linking financial management and operational performance 

Criterion 

GAO Practice 1: Build a foundation of control and accountability that 
supports external reporting and performance management. 

GAO Practice 1, Key Point 3. Internal controls meet both external 
financial reporting and performance management control objectives 
without significantly impacting efficiency. 

The District should exhibit this GAO Practice characteristic. 
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Condition 

There is a high level of linkage between the budget and organizational goals, 
plans, and policies. The Office of Performance Management reports to the 
CEO. Constant efforts are made to improve performance measurement and 
reporting. All Board action items reference Board Ends Policies to link 
activities with performance goals. In addition, the District’s conduct of this 
comprehensive performance audit indicates a strong commitment in this area. 

Board Members, the CEO, managers, and employees at all levels who were 
interviewed have a high level of consciousness regarding accountability and 
the importance of linking performance to achievement of Board Ends 
policies. Financial Services Division staff are included in this group of 
highly aware staff; however, while the District’s performance management 
efforts incorporate financial performance measures, these are not linking to 
operational objectives in a comprehensive manner. 

The Office of Performance Management, reporting directly to the CEO, has 
since its inception sought to improve performance measurement and 
reporting in the organization. This is evidenced by continuous progress in 
obtaining recognition through the California version of the Baldrige awards 
process. Flowever, their efforts are not strongly linked to the Financial 
Services Division. 

The “continuous improvement” process, while creating a high level of 
performance consciousness in the organization, has also evoked some 
confusion and a feeling of being overwhelmed. There are signs of some 
adverse reactions to the entire process among line managers. 

Effect 

The development of performance measurement and management at the 
District has been somewhat unsystematic. While good progress has been 
made in some areas, the results are somewhat fractured, leaving large areas, 
such as Financial Services, with only a minimal connection to the process. 
This is discussed in more detail in other audit memoranda and is also 
discussed at the District-wide level in the main body of the final audit report. 

Cause 

Care has been taken to ensure that performance measurement and 
management is a priority and is not “buried” in day-to-day responsibilities. 
However, as discussed in other audit memoranda, many of the performance 
metrics and performance management approaches were developed 
independent of each other and/or on an organizational unit-by-unit basis. The 
District is underway with consolidation of existing performance metrics. 

Recommendation 

A more systematic approach, including a higher level of alignment among 
line managers, could improve acceptance. Consideration should be given to 
combining the Office of Performance Excellence with the Financial Services 
Division under a Chief Financial Officer (CFO). 
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• Stakeholder involvement to develop Stewardship Plans 

• Historic leadership role and current participation in Santa Clara 
Valley Urban Runoff Pollution Prevention Program (SCVURPPP) 

The District also has an opportunity to recognize other local entities such as 
Santa Clara County or the City of San Jose as “partners” in its delivery of 
services to the community, as compared to an entity to whose actions it 
simply reacts. In many cases, the District has done this, or is in the process of 
doing this, for example, in the area of capital project delivery. For Watershed 
Operations, the District has formed a Water Resources Protection 
Collaborative composed of municipalities to gain support and participation 
with the development of a new Water Resources Infrastructure Protection 
Ordinance. Verbal information provided by audited staff indicated that 
review of proposed external projects is taking place, for example, with the 
City of San Jose regarding development in the Coyote Valley; however, the 
District has an opportunity to formalize and build upon this type of behavior. 
The District’s recognition of its “partners” and “customers” is addressed at 
the District-wide level in the main body of the final audit report. 


Cause 

Watershed Operations recognizes the importance of customer knowledge and 
opinions to provide the desired level of service, to improve its operations, 
and to gain support for funding. 

Effect 

Watershed Operations has built strong relationships with its customers and 
used this to improve its business processes. Staff exhibits a high degree of 
customer-service orientation. 


Watershed Operations Strength Finding No. 3 

Key Audit Objectives: “Operational Policies and Procedures” 


Criterion 

The District should have written operational procedures documenting the 
major functions of Watershed Operations, including roles and 
responsibilities and key performance measures. 

References 

• Baldrige Criterion 6.1. a 

« Baldrige Criterion 4.1. a. 1-3 
® Baldrige Criterion 4.1.b.l-2 

• Board Policy EL- 7. 8 

Condition 

Watershed Operations has taken a number of important steps with respect to 
documenting operating procedures, including the following: 

• Achieving the International Standards Organization (ISO) 9001 and 
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protection, reliability, infrastructure, imported water, source water diversity, 
groundwater protection/management, water recycling, and water 
conservation, based on the most recent version of the District’s Governance 
Policies (undated) made available to Red Oak in July 2006. 

As evidenced by verbal information from auditees and documentation 
provided to Red Oak, and as discussed elsewhere in this memorandum, the 
District is engaged in a wide range of activities in these arenas and has many 
notable accomplishments (e.g., high level of sophistication of imported water 
management, high diversity of water supply sources, proactive water use 
efficiency activities). 

However, the clarity, consistency, and level of specificity of the District’s 
objectives in these areas are mixed. Specifically, some objectives are 
measurable, or have associated CEO Interpretations that are measurable, 
while others are not. Furthermore, the relationships between the various sets 
of objectives and metrics for a given unit or given function are generally 
unclear. For example, some District objectives set forth in the Board’s 
Governance Policies are not consistent with those presented in the FY 2006 
WUE Business Plan or with information provided with WUE’s lists of 
internal and external customers of each WUE unit. 

As one example, in the FY 2006 WUE Business Plan, the Utility 
Maintenance Unit indicates its single customer service/satisfaction target is 
to respond to incidents within four hours, 100% of the time. The customer 
lists for all WUE units provided to Red Oak, however, indicate five primary 
and varied customers of this unit’s work, none of whom appear to be 
associated with a four-hour or similar performance metric - instead, a 
number of other metrics are in place. Additionally, it is unclear from the 
Governance Policies or CEO Scorecard material provided to Red Oak 
whether or how the measurement of this unit’s performance rolls up to any 
of the District-wide performance measures, Ends Policy objectives, or CEO 
Interpretations, although it is conceptually clear they are supporting the 
Board’s objective that “the integrity of the District’s existing Water Utility 
infrastructure is maintained.” 

Clearly, the activities and objectives of this unit as documented in various 
places in different manners are valuable to the District’s maintenance of its 
water system infrastructure; however, the District has an opportunity to 
consolidate and simplify the various and numerous sets of performance 
metrics in place at various levels for this function. As noted in Red Oak’s 
audit memorandum addressing the CEO offices, Red Oak understands that 
the District is underway with this effort. This performance metrics finding 
generally applies to all the functions and units in the WUE. The quarterly 
performance reports prepared by the Office of the COO track the WUE’s 
performance against its annual Business Plan objectives, which is 
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Cause 

District managers and staff are well-versed in the principles and practices of 
asset management, and have proactively commissioned and, more 
importantly, followed up on, a consultant study that laid out a plan of action 
for the WUE with respect to asset management. However, the practice of 
asset management has not yet been made a priority at the District-wide 
level, and the District, like many of its peers, has forecast significant 
funding shortfalls with respect to future optimum life-cycle management of 
its assets. 

Effect 

The District is well-positioned to continue to implement and improve its 
asset management program. This will result over time, in more efficient use 
of all its assets through their respective life cycles, and potentially greater 
reliability for the District’s customers. The District faces a funding 
challenge in doing so. 

Recommendation 

The District should proceed with asset management in a step-wise fashion, 
namely, to complete its current multiple asset databases within WUE, then 
use the WUE as a model for the development of asset management for 
Watershed Operations’ and all the District’s assets. The District should 
strive to ultimately manage all of is major assets in a common system, to 
facilitate the prioritization of asset maintenance, replacement, and related 
activities across the organization. The District as a whole, like its peers, 
needs to address its long-term funding/resources gap between current 
condition and rate-setting practice and identified future asset/infrastructure 
needs. This District-wide issue is addressed in the main body of the final 
audit report. 


All findings presented in this memorandum, particularly the recommendations, are to be 
considered as one component of the final audit report prepared by Red Oak. 

Views of Responsible Officials 

“Views of Responsible Officials” are included as a component of the main body of the final audit 
report. 

Nature of Any Privileged or Confidential Information Omitted 

No privileged or confidential information was omitted from this audit memorandum. 

References 

The reference list for this and all audit memoranda is included in the main body of the final audit 
report. 
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Cause 

The process for project managers within CPS—and project owners and 
stakeholders throughout the District—to ensure that Project Plan roles and 
responsibilities are thoroughly defined and adhered to throughout a project is 
not clear. 

Effect 

The lack of clear CPS staff roles and responsibilities results in a lack of 
clarity among project team members on their or others’ responsibilities on a 
given project. This confusion can lead to end products that may not meet 
owners’ and other stakeholders’ original expectations and/or needs. 

Recommendation 

Managers in CPS should emphasize the importance of clarifying roles and 
responsibilities both organizationally and on a project basis throughout the 
life of the project. This should be done both in CPS’s Project Plans and in the 
implementation/enforcement of those Project Plans throughout the cycle of 
each project. 


Capital Program Services Opportunity Finding No. 3 

Key Audit Objectives: “District oversight of consultants and contractors” 

“District quality assurance procedures used to prevent or detect errors 
and omissions in preparing capital project planning and design 
specifications, contracts, and purchasing documents ” 

_ "Operational policies and procedures ” _ 

Criterion The District should employ a systematic process involving value engineering 

or similar peer reviews on its capital projects to strive to reduce costs and/or 
improve cycle times and other key performance measures as appropriate per 
project. 

References: 

o Baldrige Criterion 6.1.a. 4: Control and improvement of value 
creation processes 

o Baldrige Criterion 6.1.a. 5: Overall cost minimization 


Condition 

CPS has an extensive process to implement value engineering or similar 
activities at the planning phase of its projects. CPS staff conducts three 
rounds of public outreach to elicit comments and ideas from stakeholders, 
and performs preliminary design and cost estimates to identify the preferred 
design alternative. However, in the design phase, value engineering is 
identified as an optional task in the QMS, and is therefore implemented only 
on a project-by-project basis in the design phase. 

Cause 

Value engineering has typically been considered too expensive for the design 
phase of the typical size project performed by CPS. It is tine that not all 
District projects are large or complex enough to warrant an industry-typical 
value engineering exercise, where a multi-disciplinary expert panel is 
convened on multiple occasions to conduct in-depth review of the District 
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PERS Stabilization Reserve - Assess actuarial reports and 
funding requirements 


8. Water Utility Rate Stabilization Reserve - Evaluate Rate history, 
policies, and procedures 

9. Encumbrance Reserve - Analyze carryover policies, procedures, 
and timeliness of liquidating open encumbrances 

10. Capital Projects/Fixed Asset Reserve - Compare the District’s 
Capital Improvement Plan to projected revenues, expenditures, 
cashflow, and funding sources 

vi. Risk management/insurance costs: 

1. Assessment ofpotential risks and adequacy of reserves 

vii. Budget policies and procedures 

via. Effectiveness and efficiency of the District's organizational structure for 

financial decision-making, planning, and management: 

1. Assessment of existing structure and comparison with best 
practices and relevant benchmarks 

2. Assessment of the District's budget process and (decentralized) 
management and staff involvement 

ix. Indirect cost management and allocation methods: 

1. Assessment of existing practices and comparison with best 

practices arid relevant benchmarks 
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xii. Contract and procurement administration: 
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Section 7 

Baldrige Category 1 - Leadership 


evidence of the Board exercising direct instruction of staff through Board advisory 
committees and/or Board Member Requests are all indicators of compromises of the 
Carver Policy Governance Model at the District. In order to gain the full benefit of the 
policy governance model, the CEO should engage in further dialogue with the Board and 
his Executive Leadership Team over the interpretations of the Board’s Ends and Executive 
Limitation Policies. The resulting interpretations should be specific, clear, and consistent 
throughout the District and fully documented, such that the executive team is comfortable 
applying them as the link between the Board’s policies and the day-to-day operations of 
the District. (See also Appendix B - CEO Audit Memorandum Finding No. 4.) 
Additionally, both Board members and the CEO need to more rigorously abide by their 
existing policies regarding their respective roles and responsibilities. Addressing this area 
would directly benefit the District’s performance related to Baldrige criteria Item 1.2 
pertaining to governance systems. 


7.3. Financial Leadership 


Another key finding of this audit in the area of leadership is that the District is currently 
lacking integration of financial considerations at the department or enterprise level, for 
example, into agency-wide strategic planning and decision-making, as is characteristic of 
high-performing organizations. An important first step in improving the District’s focus on 
financial management as an entity-wide priority would be the establishment of a Chief 
Financial Officer (CFO) position reporting directly to the CEO. This position should be 
described and staffed to enable the District to have a CFO focused “upward” and 
participate in agency-wide leadership and strategic matters while maintaining a foundation 
of accountability and control with the Financial Services Division. Under the direction of a 
CFO, Financial Services should take a proactive role in linking costing, performance 
measures, and budgeting as well as aligning systems as a key to support performance 
management. 

This issue impacts the District’s effectiveness in aligning financial matters with the 
District’s overall strategy as captured by Baldrige Criteria Item 2.1, specifically, Note 3 
pertaining to “financial” as a factor to consider in strategic planning. Better integrating 
financial leadership into agency-wide planning and decision-making would also benefit the 
District’s performance with respect to Baldrige Criteria Item 6.2.b.l, which pertains to 
considering financial resources during operational planning. Additionally, Baldrige Result 
7.3 calls for financial and market outcomes to be linked to the approaches described in 
Item 6.2. 

As noted in earlier sections, this and other audit findings throughout this report reflect the 
condition of the District at the time of Red Oak’s audit fieldwork. This is one of the areas 
where the District has already begun to address Red Oak’s audit recommendation. 
Specifically, between the time of the audit fieldwork and the preparation of this report, the 
District reported to Red Oak that it had already moved forward with the establishment of 
a CFO position and emphasis on strategic-level financial participation at the District per 
this audit finding. 


■lifOUAk Santa Clara Valley Water District 
V.' COMSU1TING Comprehensive Performance Audit Final Report 
..... March 2007-3667010 


7-5 







8. Baldrige Category 2 - Strategic Planning 


The Baldrige program defines “strategic planning” as “how [an] organization develops 
strategic objectives and action plans,’ 1 and how [an organization’s] chosen strategic 
objectives and action plans are deployed and changed if circumstances require, and how 
progress is measured. ” 

The discussion below is reflective of individual audit findings presented in all the audit 
memoranda appended to this report. 


8.1. Overall Strategic Planning 


The main departments of the District have historically been strong in the areas of business 
planning and budgeting; however, until now, this has been performed in the absence of 
formal agency-wide cohesion in the form of a District-wide strategic plan or similar effort 
to “operationalize” and prioritize the District Board’s goals across organizational 
boundaries. This is evidenced by the different formats, levels of specificity, and timeframes 
of the District’s existing strategic and business plans and the consistency with which chiefs 
and managers report difficulty with discerning District-wide priorities. The District’s 
historical department-specific approach to business planning has also inhibited its ability 
to take full advantage of its position as a unified comprehensive water resources 
management agency. Currently, the District generally lacks the well-developed 
organization-wide cohesion in planning and execution that is a trademark of the top¬ 
performing public and private-sector organizations to which the District has asked to be 
compared through its strong emphasis on Baldrige. 

Specifically, the Watershed Operations group has developed a 15-year plan for creek 
maintenance and flood control activities and a strategic plan. The Water Utility Enterprise 
prepares its own strategic plan and annual business plan while Capital Program Services 
prepares a 5-year rolling CIP along with an annual business plan. The most recent Water 
Utility Enterprise business plan (FY 2005) does link to the Board’s Ends Policies and CEO 
interpretations to the extent possible and includes prioritizations developed by the Water 
Utility Enterprise. The Capital Program Services’ 2006-2007 Business Plan links Capital 
Program Services’ business goals to Board Policies, the Capital Improvement Program, and 
Baldrige goals. Meanwhile, the Watershed Operations Strategic Plan (2002-2005) does not 
appear to link explicitly to Board Policies, and Administration does not have a strategic 
plan (although Red Oak understands that this document has been in development 
throughout the audit). 

Despite the individual strengths and thoroughness of the department-specific plans listed 
above, the District has historically not had an agency-wide strategic plan in place to 
provide the framework and boundaries for its department-specific plans. 
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Section 11 

Baldrige Category 5 - Human Resources Focus 


11.3. Staffing Level Alignment 


The District has historically assigned staffing levels on a position-by-position basis 
according to individual manager requests, or department-level program needs, as opposed 
to having a agency-wide systematic process in place to make staffing decisions, 
periodically reviewing its staffing levels District-wide, and making adjustments as 
necessary to ensure alignment with current and future business needs District-wide. This is 
one of the manifestations of the District’s opportunity for improvement with respect to 
cohesion and alignment across the District, in comparison to the District’s numerous 
individual strengths as noted throughout this report. Working towards comprehensive 
management of staffing levels is one of the areas where focused work by both the Board 
and CEO can lead to increased organizational performance and efficiency in the future. 

The number of approved positions across the organization has grown significantly (from 
636 to 903; 42%) since FY 98/99. This significant staffing increase was a cumulative 
result of individual unit-identified or program-based resource needs, but not necessarily 
the result of an agency-wide resource-loaded business plan or staffing strategy. Auditees 
expressed several speculations as to the reasons for the growth (e.g., additional 
Board/CEO “initiatives,” increased environmental awareness and stewardship, increased 
focus on performance measurement), but alone or collectively, they would only be 
expected to account for incremental staffing increases over time, not the 42% experienced. 
Such an increase would normally only be expected with a fundamental increase in the 
District’s service area, scope of services delivered, or acquisition of another agency. 

Between the time of Red Oak’s audit fieldwork and the finalization of this report, District 
staff indicated to Red Oak that the District’s need to implement the voter-approved Clean, 
Safe Creeks initiative discussed in the appended Watershed Operations audit 
memorandum was the primary reason for the organizational growth noted above. This 
point was also made by a member of the Audit Committee during its October 3, 2006 
meeting. This was not evident to Red Oak from document reviews, audit interviews, or the 
validation processes for this audit, the Watershed Operations audit, or other audits. 

Based on interviews conducted of external stakeholders for this audit, consistent input 
from District auditees, and Red Oak’s experience with the District’s peer agencies, there is 
a strong perception, both internally and externally, that the District is currently 
overstaffed. Coincident is a perception, also both internal and external, that the District is 
relatively slow to make decisions and bureaucratic, even in comparison to its large public 
agency peers. The District also relies heavily on temporary workers as discussed in the 
appended Administration audit memorandum, which also suggests a likely need for 
additional attention to an agency-wide staffing strategy. 

It is beyond the scope of this performance audit to perform a quantitative staffing level 
assessment of the District as a whole, or of any particular unit, so Red Oak cannot 
determine whether the perception noted above regarding staffing levels is accurate. In any 
case, it indicates that the District and its stakeholders have an opportunity to communicate 
more clearly regarding the District’s staffing levels and their relationship to the District’s 
need to execute voter-approved programs and deliver its other services. As noted 
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maintaining a positive public image and building community partnerships. 

Furthermore, the District should survey its key customers and high-priority 
stakeholders to gain feedback on its operations, maintain positive 
relationships, and solicit external feedback on opportunities for improvement 
from those who rely directly on its services. 

Reference: 

° Board Policies: E-4.2, EL-2.5 

° Baldrige Customer and Market Knowledge: 3.1a(l), 3. la(2) 
o Baldrige Customer Relationships and Satisfaction: 3.2a(l-4), 3.2 
b(l-4) 

o Baldrige Product and Service Outcomes: 7.1a 

Condition 

The District is to be commended for its significant dedication of resources to 
public outreach, external communication, and stakeholder involvement. 
Additionally, District Board members are very visible among the local 
community, which demonstrates the District’s commitment in this regard. 
The District’s public outreach and information efforts include facility tours, 
outreach to both educators and students, and even unsolicited calls to local 
schools in underprivileged areas. 

Closely related to Finding No. 7, the District appears to emphasize a very 
general audience for its messages, possibly at the expense of keeping its 
immediate customers fully informed and educated, based on Red Oak’s audit 
of the District’s CEO offices. 

As an example, the Office of Communications conducts an annual 
county wide survey of voters. The District should be commended for reaching 
out to its constituency with a survey. However, the survey is directed at the 
public, not the District’s immediate customers (e.g., water retailers). Also, 
the Office appears to be tracking public water-awareness issues as compared 
to directly tracking District customer satisfaction issues. The Office is not 
clear how the survey relates back to the overall vision of the District, and 
how the results are used. 

Note: Red Oak understands that the primary immediate-customer 
communication efforts may take place at the operating-group level; this topic 
is covered in the main body of the final audit report. The findings above 
reflect Red Oak’s CEO office audit only. 

Cause 

At the top level of the organization, the District has focused its outreach and 
information efforts on general water awareness and education issues. These 
are valuable pursuits for a number of reasons, but based on Red Oak’s audit 
activities at the CEO level, the District appears to be conducting these 
activities at the expense of providing more specific and necessary pieces of 
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focus on development of a transparent system that provides for prioritization, 
scheduling, and accountability for the legal services that are provided is 
essential to ensure cost-effective use of District resources and efficient 
delivery of legal services. 


Finding No. 10 - Opportuni 


Criterion 

The District Counsel’s office should have responsibility and accountability 
for all District resources that are expended for legal services. The District 
Counsel should be involved in the decision to assign any matter to special 
counsel, and in the selection, management, and oversight of special counsel. 

Condition 

Budgeting for funds for legal services is on a project/program basis, but there 
is no centralized accounting and accountability for resources spent on legal 
issues. This is not an unusual practice; however, without centralized 
accounting for legal services expenditure, the Board, the CEO, and the 
District Counsel will not be aware of all District-wide legal expenditures. 

Cause 

The District has not prioritized the centralization of its accounting for 
resources spent on legal services. 

Effect 

Even though budgeting of funds for legal services may be on a project or 
program basis, without focused centralized accounting and accountability for 
the money spent on legal services of either the District Counsel or special 
counsel, it is difficult for District decision-makers at all levels to make fully 
informed decisions as to the appropriate size and level of activity of the 
District Counsel’s office, the need for special counsel, and the effectiveness 
or efficiency of the District’s legal services expenditures. 

Recommendation 

The District should ensure that the District Counsel’s office has access to all 
District legal matters, and make this office responsible and accountable for 
the expenditure of legal resources District-wide. 


The District Counsel’s office needs to be able to account for and should have 
responsibility for all resources of the District that are expended for legal 
services. Although not always the ultimate decision-maker, the office should 
have a significant role in decisions regarding whether to assign a matter to 
special counsel, and in the management of special counsel on both litigation 
and transactional matters. 


Clear criteria are needed for determining when special counsel will be 
appointed to work on District legal matters, and to establish management 
responsibility over special counsel. Clear policy guidance is needed to 
establish that the District Counsel has direct access to the Board on matters 
requiring privileged communication and legal advice. 
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This will enable the District to (1) identify where a strategic initiative has yielded 
(or not yet yielded) a measurable benefit, and (2) indicate areas where a conscious 
decision was made to let performance in a certain area slip to dedicate resources 
to another area. 

Recommendations 

Red Oak understands that the District is in the process of (1) converting the existing Ends 
policy measures to be incorporated into the CEO Scorecard framework, and (2) 
systematically going through the organization and reviewing existing measures in use to 
decide which to retain and which to discard. We recommend this process continue, and 
provide the following additional recommendations to maximize the benefit of the 
District’s existing efforts, and to build on the information presented in the findings above. 

Implementing these recommendations will allow the District to enhance its performance 
measurement system - for example, to achieve greater clarity in reporting progress to the 
Board and other interested parties, and to gain an improved “feedback loop” from the 
measured results to the organization’s performance. Performance Excellence staff have 
indicated to Red Oak that implementation of most of these recommendations is already 
underway. 

/. Integration of all Performance Measures. We recommend that the District 
continue its work toward the integration of all previous and current performance 
measures into a single, comprehensive system that can be used both for Board 
reporting and performance management. The current CEO Scorecard appears to 
be the appropriate format for the single system, as it reflects the District’s strong 
interest in measuring and managing its performance according to Baldrige 
criteria. The benefits to the District of implementing this recommendation are 
numerous: 

a. Simplified concept of performance management for District staff and 
simplified tasks required of staff to participate in performance 
management 

b. Clarification for all District staff regarding their role in the organization 
relative to information presented to the Board and decisions made by 
management and the Board 

c. Maximized “buy-in” and participation of District staff in performance 
measurement 

d. Increased clarity of Board reporting 

e. Greater transparency of government to interested parties 

2. Reporting of Progress Against Ends Policies and Streamlining of Performance 
Measures. In the process of integrating the existing performance measures, the 
District should ensure that the final set of performance measures clearly reflects 
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other. 


Cause The Chief Executive Officer and Office of Performance Excellence 

(OPE) have made performance management a priority throughout 
the District, which is commendable. The OPE has assumed a 
leadership and coordination role, and is currently in the process of 
consolidating and standardizing metrics throughout the District as 
described in more detail in Red Oak’s audit memorandum 
addressing the District’s CEO-level functions. 

However, all or nearly all of the development of performance 
metrics has taken place at the unit manager level, with oversight in 
varying degrees by their Division managers. This has resulted in 
many cases in very useful metrics for those work processes that are 
specific to individual units. However, it has generally not resulted in 
metrics that gauge the effectiveness and efficiency of Administration 
with respect to the District as a whole, although the Chief 
Administrative Officer is clear about Administration’s goal being 
the efficient provision of high-quality administrative services at the 
District. 

Effect The District is developing a wide range of very useful metrics for 

individual unit performance, and is working to select the most 
important of those for inclusion in the overall District-wide 
performance measurement system that will report District 
performance to the CEO and Board. 

Setting performance goals and monitoring progress toward them 
communicates the District’s priorities and focuses staff on meeting 
these priorities. Also, properly developed performance measures 
allow unit managers and staff to directly link their work activities to 
the District Board’s policies and CEO’s interpretations. Evidence of 
this was noted throughout Administration, demonstrating staffs 
generally high level of awareness of the District’s overall goals. 

In general, unit and Division managers are very focused on their 
organizational unit’s performance, and are directly engaged in the 
development of performance measures for their respective units. 
However, there are no metrics that help District answer overall 
questions about the provision of its administrative services related to 
staffing levels, overhead/cost control, District-wide use rates of 
corporate services, development of support services in parallel, and 
the cost-effectiveness when offered as a centralized function. 

Such metrics, properly developed and tracked, and related directly to 
agency-wide strategic goals in these areas, would provide the Chief 
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Finding No. 11 - Strength 

Key audit objective: “Risk management/insurance costs ” 


Criterion 

The total liabilities of claims by line of coverage (e.g., workers’ 
compensation or liability) for a policy year should be subject to actuarial 
analysis and an estimate of future costs should be developed taking into 
account claim “development” and “incurred but not reported” (IBNR) 
claims. 

References: 

® Board Policy EL-7: Asset Protection 

• GASB Statement No. 10 

• Baldrige — 5.3: Employee Well-Being and Satisfaction 

Condition 

The District is to be commended for its regular actuarial analysis and 
future cost estimation. Workers’ compensation and liability claims are 
subject to actuarial review every other year. 

Cause 

The Risk Management Administrator has arranged for this review in 
accordance with generally accepted practice and in compliance with the 
intent of Governmental Accounting Standards Board (GASB) Statement 
No. 10. 

Effect 

Actuarial review helps assure that liabilities arising out of the District’s 
fortuitous loss events are recognized properly, that adverse claim 
development, trends and unreported losses are accounted for, and that 
sufficient funding is encumbered for payment of claims. 


Finding No. 12 - Strength 

Key audit objectives: “Risk management/insurance costs ’’ 

“Management of real property owned by the District and physical assets - 
facilities and infrastructure ” 


Criterion 

The CEO should maintain property insurance for the District’s 
occupied buildings and contents to at least the value of probable 
maximum loss. 

References: 

• Board Policy EL- 7 (7.1): Asset Protection 

Condition 

The District is to be commended for maintaining accurate values on its 
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individual requests. In brief, a manager desiring a new position in 
his or her unit submits a Position Action Request (PAR) to a staff 
analyst in Human Resources (HR), where the PAR is reviewed by 
the Classification and Compensation Unit. If and when HR approves 
the PAR, it is foiwarded to the four District chiefs for review and 
approval. 

As noted in an earlier finding, the number of approved positions 
across the organization has grown approximately 40% since FY 
98/99. Based on Red Oak’s review of the District’s Human 
Resources and other documents, and on consistent verbal 
information from all auditees, this significant staffing increase was a 
cumulative result of individual unit-identified or program-based 
resource needs, but not necessarily the result of an agency-wide 
resource-loaded business plan or staffing strategy. Auditees 
expressed several speculations as to the reasons for the growth (e.g., 
additional Board/CEO “initiatives,” increased environmental 
awareness and stewardship, increased focus on performance 
measurement), but alone or collectively, they would only be 
expected to account for incremental staffing increases over time, not 
the 40% experienced. Such an increase would normally only be 
expected with a fundamental increase in the District’s service area, 
scope of services delivered, or acquisition of another agency. 

Between the time of Red Oak’s audit fieldwork and the finalization 
of this audit memorandum and the main body of the audit report, 
District staff indicated to Red Oak that the District’s need to 
implement the voter-approved Clean, Safe Creeks initiative 
discussed in the Watershed Operations memo was the primary 
reason for the organizational growth noted above. This point was 
also made by a member of the Audit Committee during the October 
3, 2006 Audit Committee meeting. This was not evident to Red Oak 
from document reviews, audit interviews, or the validation processes 
for this audit, the Watershed Operations audit, or other audits. 

Based on interviews conducted of external stakeholders for this 
audit, consistent input from District auditees, and Red Oak’s 
experience with the District’s peer agencies, there is a strong 
perception, both internally and externally, that the District is 
currently overstaffed. It is beyond the scope of this performance 
audit to perform a quantitative staffing level assessment of the 
District as a whole, or of any particular unit, so Red Oak cannot 
determine whether that perception is accurate. In any case, it 
indicates that the District and its stakeholders have an opportunity to 
communicate more clearly regarding the District’s staffing levels, 
and their relationship to the District’s need to execute voter- 
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the organization. The District may also want to ensure its cost-sharing and 
grant efforts are adequately reflected in its current or future performance 
measures, as it may be a key component of demonstrating financial 
responsibility and local/state/federal coordination to external interests. This 
also represents a key opportunity for operational and Administration staff to 
work together on shared objectives and towards common performance 
metrics. 

FINDING 1.0(c) - Reserves and Capital Financing 

Criterion 

The GFOA has adopted recommended practices that emphasize the 
importance of establishing “reserve or stabilization accounts” at a “prudent 
level” in order to “protect against the need to reduce service levels or raise 
taxes and fees due to temporary revenue shortfalls or unpredicted one-time 
expenditures.” Jurisdictions should, according to the GFOA, adopt policies 
that reflect these goals. Fitch Ratings has stated that “maintaining an 
operating reserve or Tainy-day’ fund is perhaps the most effective practice 
an issuer can use to enhance its credit rating.” The GFOA has further 
identified a reasonable range of fund balance in the General Fund to be 
approximately 5 to 15 percent of operating revenues, and not less than one to 
two months of operating expenditures. General practice among utilities, 
based on audit team experience, is to maintain working capital reserves of 
from two to six months’ operating and maintenance expenditures. 

Generally Accepted Accounting Principles for government entities require 
accountability for fund balances so that users of financial statements can 
understand for what purposes residual financial resources in the various 
funds are available. Those resources restricted to certain uses by law or third- 
party agreements such as bond covenants should be distinguished from 
resources that are identified for future specific uses by management and 
those that are available for any purpose allowed by law. 

Because the degree to which resources are held for future use has an impact 
on the District’s revenue requirements and consequently affects current rates 
and charges for services, clear reserve policies and justification for reserve 
levels are important factors in accountability to customers and other 
stakeholders. 

The District’s financial management practices should be in alignment with 
all of the above. 
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repairing damages caused by failures. 

According to the FY04-05 Urban Runoff Program Annual Report, 
enforcement of the District’s Ordinance 83-2 has been hampered due to lack 
of staff and funding. Draft Ordinance 06-1 (June 19, 2006) is a new Water 
Resources Infrastructure Protection ordinance, which is scheduled to be 
adopted in October 2006 and rescind Ordinance 83-2. The new ordinance 
was developed with input from the Water Resources Protection 
Collaborative, of which the District is a member, and has improved clarity of 
governance and jurisdiction, and improved enforcement authority. (Red Oak 
also understands, based on comments made at the July 25, 2006 Audit 
Committee meeting, that the Board’s Environmental Advisory Committee 
and Agricultural Water Advisory Committee are also commenting on the 
proposed ordinance. The ordinance follows a municipal ordinance structure 
so it can be better understood by the District’s partners in water resources 
protection. The District is in the process of developing a manual that outlines 
the standards to evaluate permit applications and requirements for 
compliance with the Ordinance. 

Cause 

The District has recognized and acted on the need for effective partnering 
with communities with respect to effective management and enforcement of 
its Watershed Operations right-of-ways, but is still in the development 
process. 

Effect 

If and when the District’s ordinance regarding activities next to or in its 
Watershed Operations right-of-ways is violated and not enforced, water 
resources may be adversely affected in multiple ways. In addition, unplanned 
expenditures and staff work activities result if failures cause repair work. 

Recommendation 

The District should continue and expedite its efforts to review, adopt, and 
implement the proposed ordinance. An example of a peer agency that has 
implemented a similar ordinance is the Milwaukee Metropolitan Sewerage 
District in Milwaukee, Wisconsin. 


Watershed Operations Opportunity for Improvement Finding No. 5 
Key Audit Objectives: “Operational policies and procedures” 


Criterion 

The District should develop, implement, and maintain integrated and up-to- 


date hydrologic and hydraulic models of District facilities. Key elements of 


this function include collecting and compiling precipitation and flow data, 


performing watercourse damage assessments, setting project priorities, and 


maintaining and making full use of planning, analysis, and design 


information. 
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October 2005 headcount provided to Red Oak) and has an annual budget of approximately $148 
million (per the FY 2006 WUE Business Plan). More background information on the WUE is 
available in District documents such as the District budget and the Water Utility Enterprise 
Report, both of which are prepared on an annual basis. 

Audit Criteria and Findings 

In accordance with GAGAS, Red Oak established audit criteria for the WUE audit, based on the 
following sources: 

• The District’s audit objectives as included in the scope of work and described above. 

® The Governance Policies of the District’s Board of Directors. 

• Malcolm Baldrige National Quality Program criteria, specifically, those pertaining to 
strategic planning; customer and market focus; measurement, analysis, and knowledge 
management; process management; and business results. 

• The Red Oak audit team’s collective experience in the public and private sectors of the 
water industry, and with analogous water resources management and utility entities 
nationwide. 

Red Oak developed findings based on the fieldwork and document review described earlier in 
this memorandum. These findings are presented below according to the GAGAS findings 
structure, and are designated as either “Strengths” (positive findings with no associated 
recommendation or only minor suggestions for improvement) or “Opportunities for 
Improvement” (findings with significant associated recommendations for improvement). The 
District’s key audit objectives to which each finding most directly relates are also indicated. 
Please note that the findings in this audit memorandum are not presented in any particular order, 
although they are organized according to strengths and opportunities. 

WUE Strength Finding No. 1 

Related Key Audit Objectives: “Operational policies and procedures ” 

“Compliance with state and federal regulations ” 

“Environmental management ” 


Criterion 


The District should track and be able to demonstrate its compliance with all 
regulatory requirements that govern its WUE operations, and demonstrate its 
plans and actions for improving its regulatory results over time. The District 
should be exceeding regulatory requirements as appropriate and consistent 
with its vision and mission. These activities include its treatment plant 
operations, its finished water quality, its raw water operations, and any other 
applicable regulated activities. 

References 

@ Board Policy GP-1: 1.1 

• Board Policy E-2: 2.1.1 

• Baldrige Criterion 1.2.b.l 
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appropriate for esoteric analyses for which it does not make economic sense 
for the agency to run the method in-house, or to handle spikes in analytical 
workload. However, this situation appears to be an opportunity for improved 
internal coordination, reconciliation of the missions, customers, and services 
of the WUE units involved, and increased clarity regarding the WUE’s 
policy regarding the utilization of existing in-house laboratory resources. 

The District also has an opportunity to further recognize other local entities 
(e.g., Santa Clara County, the City of San Jose) as “partners” in its delivery 
of seivices to the community, as compared to an entity to whose actions it 
simply reacts. In many cases, the District has done this, or is in the process of 
doing this, for example, in the area of capital project delivery. However, 
WUE documents provided for Red Oak’s review in the areas of water supply 
sustainability and groundwater management indicate that the District’s 
primary role is as a “responder” to questions from external agencies 
regarding the District’s long-term planning, or “reviewer” of proposed 
projects by other agencies, respectively, instead of a partner with the other 
agency with shared objectives. Verbal information provided by auditees 
indicated some of this type of activity is talcing place, for example, with the 
City of San Jose regarding development in the Coyote Valley; however, the 
District has an opportunity to formalize and build upon this type of behavior. 


Cause 

The WUE recognizes its role as a customer service provider to its water 
retailers and other customers, and has placed a priority on interacting 
regularly with these customers to ensure it is providing them with the desired 
level of service and to continually improve its operations. 

Effect 

The WUE of the District has built generally strong relationships with its 
customers, and has been able to capitalize on this fact as evidenced by 
business process changes driven by customer feedback (e.g., retailers’ survey 
results). The District has also instilled a high degree of customer service 
orientation into its WUE staff, as evidenced consistently in audit interviews 
and in the detailed lists of customers and services that each unit within WUE 
has developed. The WUE has a number of relatively minor areas for 
improvement in terms of integrating customers into its activities, and has a 
strong foundation of customer focus on which to build. 

WUE Strength Finding No. 3 

Related Key Audit Objective: “Reliability of service ” 

Criterion 

The District should have reliability goals in place for its Water Utility 
Enterprise function, incorporating source water reliability, management of 
its groundwater basins, treatment reliability, water recycling, and/or any 
other key components of the water service reliability the District offers its 
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• Research into water supply management and utility operations 
practices in place at East Bay Municipal Utility District (EBMUD), 
Metropolitan Water District of Southern California (MWD), the San 
Francisco Public Utilities Commission (SFPUC), Seattle Public 
Utilities (SPU), and other peer agencies. 

1 j 


• Staff participation in regional, state, and federal arenas with respect 
to the District’s imported water. These include CALFED, the Bay 
Area Water Agencies Coalition (BAWAC), the Bay Area Water 
Agencies Forum, California Urban Water Agencies (CUWA), the 
Northern California Salinity Coalition, and others. 
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• District WUE operations staff have brought in OMI, a Baldrige 
award winner, to present to staff - this represents a commitment to 
continuous improvement and a willingness to learn from and share 
information with one of the District’s leading private-sector water 
utility operations counterparts. 
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• As noted in the WUE Business Plan, the District has investigated 
“lean” manufacturing methods in order to improve its treatment plant 
operations - an example of looking outside their industry for best- 
practice ideas, a characteristic of high-performing organizations and 
very consistent with the Baldrige approach the District has adopted. 

i j 
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Staff interviewed generally indicated a high level of awareness regarding 
how their work units or programs compared with those of the District’s water 
agency peers. Also, District staff “own” and track progress against external 
assessments of WUE operations, such as the 2000 assessment of WUE, as 
evidenced by the detailed tracldng sheet provided to Red Oak for review and 
verbal confirmation with auditees. 
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Day-to-day quality assurance (QA) procedures to identify deficiencies, make 
corrective actions, and evaluate the effectiveness of those actions are 
currently generally undocumented; however, as the District moves towards 
agency-wide ISO standardization, the WUE will have an opportunity to 
document its QA steps. 

ii 

Cause 

WUE staff place a high priority on networking, participating in industry 
forums, and understanding best-practice behaviors and applying them at the 
District to the extent possible. 

fv.j 
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Effect 

This results in WUE staff being as valuable a resource as possible to the 
District regarding continued improvement of its WUE work processes, and 
comparing the District realistically against its high-performing peers in the 
water industry. 
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The effect is that the District may be expending more effort than necessary to 
measure and report on its performance, and that internal and external 
stakeholders may be unclear on what metrics indicate the WUE is achieving 
its objectives. 

Recommendation 

Red Oak recommends that the District continue with, and expedite, its efforts 
at standardizing and reconciling the various performance and customer 
satisfaction measurement systems in place in the WUE and across the 
District, with a focus on measuring key business processes as opposed to the 
outputs of organizational units. This will ultimately maximize internal “buy- 
in” and participation in the District-wide performance measurement process, 
and increase the clarity with which the District can demonstrate its success to 
internal and external audiences. Implementation of an established, 
consolidated performance measurement system from year to year will also 
enable the District to discern trends in performance over time and manage 
accordingly. 

The District has reported to Red Oak that it has made significant progress in 
this area between the time of the audit fieldwork and the preparation of Red 
Oak’s final audit report and the finalization of this and the other audit 
memoranda. Specifically, the District has been moving forward with the 
development of a “CEO Work Plan” and associated performance metrics, in 
part, to address some of the issues raised in this finding. 


WUE Opportunity for Improvement Finding No. 2 
Related Key Audit Objective: “Cost" 


Criterion 

The District should have cost-related performance metrics/targets in place 
regarding its WUE operations, and track these metrics over time in an effort 
to reduce costs where appropriate given its level-of-service goals. 

References 

• Board Policy GP-1: 1.1; 1.3 

• Board Policy E-2: 2.1.1 

• Board Policy: EL-5: 5.11 

• Board Policy EL-7: 7.9 

• Baldrige Criterion 6.2.a. 3 

Condition 

Cost metrics 

At the time of Red Oak’s WUE audit fieldwork, the WUE had a single cost- 
related metric in place that pertained to the WUE as evidenced by the July 
2005 Governance Policies: to keep the cost of treating water less than $118 
per acre-foot of water treated. The basic idea behind this metric was a good 
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Condition 


References 

• Board Policy GP-1:1.1-1.3 
® Board Policy E-l 

® Baldrige Criterion 2.1 (all) 

• Baldrige Criterion 4. l.a.2 

• Baldrige Criterion 6. l.a. 6 


At the time of Red Oak’s audit fieldwork, the WUE had developed and was 
using a long-term strategic plan and an annual business plan; however, there 
was no District-wide strategic/business plan in place to which these plans 
related. This is consistent with regular feedback from interviews indicating 
prioritizing budget items and activities within an operating department (e.g., 
WUE or Watershed Operations) is relatively straight-forward, while 
prioritizing things agency-wide can be difficult. At the time of this writing, 
the District is underway with the development of a “CEO Work Plan,” which 
will be incorporated into the FY 2006-2007 budget and perhaps serve as the 
agency-wide business plan that historically has been lacking. The WUE’s 
plans generally do contain certain measurable goals; however, the District’s 
tracking of its progress against their goals is somewhat fragmented as noted 
in an earlier finding in this memorandum. 

The District has a clear benefit over many of its agency peers with respect to 
its ability to conduct “comprehensive water resources management” in the 
County because it houses both water supply and watershed operations 
functions in a single organization. 

Based on Red Oak’s review of documents provided by both the WUE and 
Watershed Operations, and consistent feedback from auditees, the District 
takes advantage of this arrangement in some cases, while in other cases does 
not, or operates at cross-purposes. Specifically, the operation of the District’s 
reservoirs and local water supply systems is a case of strong coordination 
among the District’s main functions, as noted in an earlier finding regarding 
maintenance of stream flows for fish habitat purposes, and as evidenced by a 
review of the District’s local water policies and procedures and very 
consistent information from auditees. This is indicated in the District’s most 
recent Hydrologic Data Management Report, and additional evidence for 
operating the District’s local water systems for multiple purposes (water 
supply, flood control, habitat maintenance, and general environmental 
stewardship) is provided in the WUE’s Business Plan. The WUE and 
Watershed Operations also collaborate strongly in the area of hydrologic data 
for both flood control and water supply purposes, as indicated in customer 
lists and the hydrologic data report noted above. 

An instance of the District taking action in the broader interest of regional 
water quality as opposed to simply its own needs is its corrosion inhibitor 
switch to a non-zinc product as noted in its Water Utility Enterprise Report, 
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On the face of it, there is a significant difference of opinion on this issue. SCC/MAD 
recommends $147.7 million in net adjustments; the District agrees with $13.2 million. 

Capital Projects Adjustments. Upon closer inspection it appears that much of the difference 
can be accounted for in terms of semantics. $127.7 million of the SCC/MAD adjustments are 
in the Capital Projects area; of these, $59.8 million apply to capital expenditures and $67.9 
million to capital reserves. SCC/MAD does not argue that these funds should not be 
earmarked for capital projects, only that the status of the funds be made clear. It is quite 
correctly pointed out that actual appropriation of funds for projects that have not been 
contracted for could lead to a misunderstanding of the District’s ability to change its spending 
plans over the long term. On the other hand, we do not believe that it is entirely correct to 
characterize these adjustments as providing “Additional Resources” without some 
qualification, because they are generally restricted for use in funding capital projects. 

We recommend that the District clarify the capital projects funding process by using the 
following approach: 

1. Formally appropriate funds only for current year expenditures. 

2. Reserve funds for expected future-year expenditures under current contracts, specifying 
the projects and timing of future expected expenditures. However, if District legal 
counsel believes that current contacts should be appropriated in the amount of the 
entire contract, then this legal requirement should take precedence. Expected annual 
expenditures for future years through the life of each project should be detailed in 
supporting documentation. 

3. Restrict funds that are limited in general purpose by external requirements (e.g., inter¬ 
governmental agreements, voted levies, legal funding source restrictions), specifying in 
as much detail as practical the planned specific future projects to which those funds are 
expected to be applied. 

4. Designate funds that have been earmarked for future projects by management or the 
Board, providing as much detail as possible on the expected expenditures by year and 
project. 

This approach should provide a clear understanding of the status of these funds so that policy¬ 
makers are aware of their options. 

Operating Reserves Adjustments. SCC/MAD recommended $16.1 million in adjustments in 
this category. The District agreed to $6.5 million. Of that, $2.3 million was the result of an 
examination of unreserved fund balances based on new information available since the original 
submission of the budget. The District agreed to adjust insurance reserves by $4.2 million 
compared to the County recommendation of $6.2 million, but is in the process of further 
examining its approach to forecasting losses that may result in further adjustments. 

The major source of controversy in this area is the $3-million rate stabilization reserve held in 
the Water Utility Enterprise Fund. Our examination of reserves in that area of 
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List of Interviewees 


Board of Directors and Chief Executive Offices Audits 1 

Board Members 


Tony Estremera, Member, Board of Directors 
Joe Judge, Member, Board of Directors 
Rosemary Kamei, Member, Board of Directors 
Sig Sanchez, Member, Board of Directors 
Richard Santos, Chair, Board of Directors 
Larry Wilson, Member, Board of Directors 
Greg Zlotnick, Member, Board of Directors 

District Staff 

Rick Callendar, Manager, Government Relations 

Debra Cauble, District Counsel 

Chris Elias, Officer, CEO/Board Support 

Jim Fiedler, Chief Operating Officer (COO), Watershed Operations 
Penny Flynn, Communications/Community Relations Manager 
Nai Hsueh, COO, Capital Program Services 

Olga Martin-Steele, Chief Administrative Officer (CAO), Administration 
Peter Ng, Deputy Administrative Officer (DAO), Financial Services 
Peter Sakai, Chief, Office of Performance Excellence 
Walt Wadlow, COO, Water Utility Enterprise 

Stan Williams, Chief Executive Officer, Santa Clara Valley Water District 
External Stakeholders 

Richard Balocco, San Jose Water Company 
Erin Garner, Monte Sereno City Council 
Jan Garrod, Santa Clara County Farm Bureau 
Brian Schmidt, Committee for Green Foothills 


1 All titles and organizational placements throughout this appendix reflect the time of Red Oak’s audit 
fieldwork for each audit area. 
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Scope of Work 

Excerpted from May 25, 2005 Agreement No. A2921A and its July 3, 2006 
Amendment No. 1 between the Santa Clara Valley Water District and 
Red Oak Consulting, A Division of Malcolm Pirnie, Inc. 












3.3.7 Real Estate 

3.4 Water Utility Enterprise 

3.5 Watershed Operations 

3.6 Capital Program Services 

C. Scheduling interview dates, times and locations with District staff members and 
external stakeholders 

D. Setting up meeting and workshop dates, times and locations 

E. Coordinating District staff schedules and resources for workshops and meetings 

F. Coordinating District staff review of Consultant deliverables, compiling comments 
on them into single documents, and transmitting them to the Consultant’s Project 
Manager or his designee (e.g., Deputy Project Manager) 

G. Collecting requested documents and delivering to the Consultant 

H. Providing additional copies of District documents if requested by the Consultant 

I- Providing two office spaces or cubicles for the Consultant’s audit team members’ 
use with telephone, internet connections and access to a laser printer 

J. Providing one small private conference room with capacity for 6 - 8 people and a 
speaker phone 

K. Providing Consultant staff with access to a copier and fax machine 


VII. Scope of Services 

A. Pursuant to the work plan developed by the Consultant, this Scope of Services is 
organized according to the organizational structure of the District to best describe the 
details of how the audit will be conducted. The Consultant recognizes that many audit 
objectives and District work processes cross organizational boundaries. Review of all 
pertinent objectives and processes, regardless of breadth across the District, is built into 
the audit tasks described below. 

B. “Progress milestones” indicated in selected areas are in accordance with the attached 
budget and are numbered according to the task they immediately follow, at the level of 
task breakdown appropriate to each. 
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Work with the Office of Performance Excellence to collect and review documents describing 
existing progress on in-house implementation of Baldrige-based performance 
measurement system. These are expected to include: 

• 2004 CAPE Application 

9 California Council for Excellence 2004 California Prospector Feedback 
Report 

• Most recent “Ends Quarterly Monitoring Report” prepared by District staff for 
the Board 

• Most recent “Initial CEO Scorecard - Summary” prepared by the District 

• List of current engineering, consulting, and construction contracts 


Task 2.2 Assumptions 

Meetings: 0 
Interviews: 0 

Deliverables: no written deliverables 


Progress. Milestone 2.2 


$5,’942 


2.3 Summary of Existing Performance Measurement Program 
and Development of initial Audit Work Plan 

2.3.1 Conduct one meeting with Performance Excellence staff to review outcome of the 
Consultant’s review of Task 2.2 documents 

2.3.2 Develop high-level overview of existing District performance management 
process, including a flow chart and samples of criteria, goals/objectives, 
standards/measures, and products (“Document the System”) 

2.3.3 Prepare brief memorandum summarizing the existing District performance 
management process, identifying any significant gaps noted and providing any 
recommendations 

2.3.4 Revise (if necessary) overall audit plan based on this summary and 
recommendations - this will be the working basis for conducting the Board of Directors 
audit (Task 3.1) and subsequent audits 

2.3.5 Develop conceptual-level tools and methodology for use during the audit phases 
(evaluation frameworks, checklists, questionnaires, and/or any other tools deemed 
necessary) 
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AMENDMENT No. 1 to AGREEMENT A2921A 
APPENDIX ONE 
SCOPE OF SERVICES 


CONTRACT NAME Comprehensive Performance Audit FILE # 2920 

Change Order Deliverables 

The Consultant shall conduct four additional audit validation meetings to verify audit findings. 

The Consultant shall prepare an additional Interim Audit Memo containing advice to the District on the 
recommendations contained in the FY2006 Santa Clara County review of the District Budget, issued by the 
County Board of Supervisors in 2005 

The Consultant's representative, Mr. R. Lockridge, at the request of the District, will present information to the 
Santa Clara County Civil Grand Jury relative to the nature of the District's Comprehensive Performance Audit. 

A7 New Task 7 - Additional Audit Validation Work 

The Consutant shall conduct a total of 4 additional audit validation meetings District staff to verify audit findings. 
Task Deliverables 

The Consultant shall conduct four additional audit validation meetings to verify audit findings. 

7.1 The Consultant shall conduct an additional audit validation meeting (1 of 4) 

This is the first of four additional validation meetings. This meeting is for the Financial 
Services/Administration portion of the Audit (3.3). 

7.2 The Consultant shall conduct an additional audit validation meeting (2 of 4) 

This is the second of four additional validation meetings. This meeting is for the Water Utility 
Enterprise portion of the Audit (3.4). 

7.3 The Consultant shall conduct an additional audit validation meeting (3 of 4) 

This is the third of four additional validation meetings. This meeting is for the Watershed Operations 
portion of the Audit (3.5). 

7.4 The Consultant shall conduct an additional audit validation meeting (4 of 4) 

This is the fourth of four additional validation meetings. This meeting is for the Capital Program 
Services portion of the Audit (3.6). 

A8 New Task 8 - The Consultant shall prepare a separate (Additional) Audit Memorandum 

This additional audit memorandum specifically addresses the recommendations from the County of Santa Clara 
Board of Supervisor's review of the District budget by the County's Management Audit Division. This 
memorandum is to provide information and advice to the District Board in response to the Management Audit 
Division's recommendations contained in the FY2006 budget review. 

Task Deliverables 

The Consultant shall prepare an additional Interim Audit Memo containing advice to the District on the 
recommendations contained in the FY2006 Santa Clara County review of the District Budget, issued by the 
County Board of Supervisors in 2005 


Consultant Initial: 


Contract: Comprehensive Performance Audit 
Printed: 06/29/06 


File# 

Page: 


2920 
2 of 4 





Section 1 
Executive Summary 


number of opportunities for improvement manifested throughout the organization that 
could be addressed with the development of, and adherence to, a clear, specific District¬ 
wide strategic plan. These include fully realizing the potential benefits of the District’s 
policy governance model, cost and overhead control, priority-setting, budget adherence, 
and incorporating all areas of the organization in the District’s delivery of its core services. 

Another theme that emerged from Red Oak’s audit activities is relevant to the District’s 
pursuit of continuous improvement and striving for excellence. While pursuing forward- 
thinking activities like implementing a policy governance model, pursuing International 
Standards Organization (ISO) certification throughout the agency, and developing agency¬ 
wide performance measurement aligned with the Baldrige program, there are some 
fundamentals that need focus. Specifically, the District has a number of areas that, if not 
addressed, could impede its pursuit of implementing best practices in all areas of the 
agency and its delivery of top-quality core services to its customers. These include Health 
& Safety, floodplain management definition, and implementation of a complete Enterprise 
Resource Planning (ERP) system. 

Auditing a dynamic organization is necessarily challenging, in that such an organization is 
likely to undergo change and/or implement audit recommendations between the time of 
the audit fieldwork and the preparation of the final report. This was certainly the case 
with Red Oak’s audit of the District. Specifically, since the time of Red Oak’s audit 
fieldwork, the District reported to Red Oak that it is already underway with a number of 
improvements that address some of the most significant findings of this audit report. These 
include: elevation of the financial function in the organization, direct linking of the 
District’s annual budget to its Board’s “Ends” policies, reconciliation of existing 
department- or unit-level strategic planning efforts and development of an agency-wide 
plan, comprehensive staffing planning, and consolidation and alignment of performance 
measurement efforts across the organization. 

The fieldwork for this audit was complete as of August 2006. As a result, actions taken by 
the District since that time such as the ones noted above were generally not reviewed in 
detail for this report, but are acknowledged to the extent possible. A key benefit of the 
“Views of Responsible Officials” section of this report (Section 13) is to allow the District 
to describe its current and future implementation efforts in greater detail than this audit 
report. 

It is clear to Red Oak that the District has the collective desire and talent to continue to 
build upon its numerous existing strengths and address the recommendations in this audit 
report regarding the topics above and others. Red Oak recommends that the District 
continue its efforts in the area of process improvement and performance management. The 
audit recommendations in this report suggest where the District should focus these efforts, 
and Red Oak recognizes that the District will refine its implementation of the 
recommendations as stated in this report to reflect changing conditions over time. Red 
Oak also recommends that the District review and synthesize the input it has received 
from a number of third parties recently, including its annual Baldrige process and the 
Santa Clara County Grand Jury’s recent assessment, in addition to this audit. Red Oak 
will be addressing this topic in its upcoming audit recommendation implementation 
workshop with the District. 
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5. Final Report Organization 


As indicated in the appended memoranda, Red Oak developed 114 individual findings— 
both “strengths” and “opportunities”—during the course of this audit. Many of these 
findings are specific to a particular work process or topic at the District and were not 
affected by the findings from previous or subsequent audits. Other individual findings at 
the department level turned out to be components of a District-wide finding or otherwise 
cross organizational boundaries at the District. To organize and best present all the 
findings developed during this audit, Red Oak performed the following: 

• Discussed District-wide or over-arching findings in the main body of this report. 
These discussions synthesize findings previously developed at the individual audit 
level. Red Oak elected to organize these according to Baldrige categories because 
of three main factors: (1) the close alignment between Baldrige categories and Red 
Oak’s District-wide audit findings, and (2) the desire to facilitate the transition 
from the audit to the implementation phase, which the District plans to execute 
with the assistance of Baldrige Champions as discussed in an earlier section, and 
(3) the direct match with the District’s existing Baldrige-based performance 
management framework. 

® Appended all interim memoranda to this report for the District’s reference for 
detailed department-specific discussions on the issues discussed in the main body of 
this report, and to document the more specific findings noted above and not 
reproduced in the main body of this report. 

• Created a single list of all findings, noting their source (i.e., which individual 
audit), their type (“strength” or “opportunity”), and a brief description of the 
finding/recommendation. This list also includes Red Oak’s relative scores of the 
“condition” of each area and key parameters associated with implementation of 
the associated recommendations. This is discussed in the following section. 
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Section 10 

Baldrige Category 4 - Measurement, Analysis, and Knowledge Management 


necessary) capital projects. Ideally, asset management tools should be used to develop 
standard life-cycle analysis procedures from which staff can develop and better understand 
cost/benefit decisions. 

Long-term Water Utility Enterprise asset management needs are forecasted but a 
mechanism to fully fund them is not yet in place. All Water Utility Enterprise auditees 
involved with asset management and/or the District’s finances recognize that forecasted 
water rates will be insufficient to meet the Water Utility Enterprise’s future asset 
management and infrastructure needs. This is typical for the District’s peer group, but still 
represents a gap with respect to the desired condition. The District faces a similar situation 
on the watershed operations side of the agency in terms of ensuring that long-term funding 
is in place to sustain its ongoing operations, maintenance, and mitigation commitments 
and generally increasing environmental stewardship activities and obligations. These 
points are discussed in further detail in the appended Water Utility Enterprise and 
Watershed Operations audit memoranda, respectively. 

Additionally, District staff provided Red Oak with a detailed analysis indicating a recent 
declining trend in human and financial resources assigned to asset management and 
maintenance while maintenance needs and the number of assets were increasing. This is 
also echoed in the District’s in-house look at its long-term water supply sustainability as 
well as the Water Utility Enterprise’s Business Plan. Although a detailed staffing level 
analysis is outside the scope of this audit, the preparation of these analyses by staff 
underscores the finding in Red Oak’s appended Administration audit memorandum that 
the District as a whole needs to continue its efforts toward a more rigorous and consistent 
job of assigning human resources according to its business needs. 

The District is well-positioned to implement and improve its asset management program, 
and the majority of staff and managers are well versed in the principles of asset 
management. The District may wish to proceed with this program in a step-wise fashion, 
completing its current multiple asset databases within Water Utility Enterprise, then using 
the Water Utility Enterprise as a model for the development of asset management for all 
the District’s assets. 

The District should strive to ultimately manage all of its major assets under a common 
system, to facilitate the prioritization of asset maintenance, replacement, and related 
activities across the organization. The District as a whole, like its peers, needs to address 
its long-term funding/resources gap between the current condition and rate-setting practice 
and future asset/infrastructure needs. Asset management is closely related to Baldrige 
Criteria Item 4.1, which addresses “selection, alignment, and integration of data and 
information for tracking daily operations and overall organizational performance.” 


10,3. Measurement of Performance and Quality of Service 


The District is among the leaders of its peers with respect to efforts made in the area of 
performance measurement, and is to be commended for its establishment of its Office of 
Performance Excellence and ongoing efforts to standardize performance measurement and 
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February 15, 2007 


Introduction 

The draft Red Oak Performance Audit Final Report notes that the District “...has built a 
reputation as an agency focused on top-quality service to the community, effective governance 
and leadership, and continuous improvement.” The District’s vision of performance 
excellence, which includes transparent and accountable management, is the driving force 
behind our seeking independent assessments such as the Red Oak audit. 

Since 2004, the water district has undergone five such assessments, which have resulted in 
nearly 300 identified opportunities for improvement (OFIs) overall. Of these assessments, both 
the Red Oak performance audit and the 2004, 2005 and 2006 examinations from the California 
Awards for Performance Excellence (CAPE) utilized criteria from the Malcolm Baldrige 
National Quality Award. Baldrige criteria are used in recognizing best-in-class, top-performing 
organizations. The District requested that Red Oak use Baldrige to “stretch” the organization 
towards further improvement. 

With many sources of recommendations for improvement, a key challenge for the District is: 
Flow should we navigate our journey toward performance excellence, considering all the 
initiatives that could be pursued? In the audit, Red Oak recognizes the district’s forward- 
thinking activities, and recommends that the District review and synthesize the audit findings 
together with OFIs from the other assessments. The District agrees and is currently performing 
such a review. Initial themes from all assessments are provided beginning on page 9. 

Red Oak provides guidance for addressing this challenge by identifying two over-arching 
issues for the District: need for organizational cohesion and focus. We concur that these 
fundamental alignment issues must be addressed as part of the District’s performance 
excellence vision, and have begun to integrate them into our strategic planning efforts. 

As Red Oak notes, the District is an organization that does not wait long when we can see a 
way to improve. In addition to the longer-term review of assessments, the District has already 
taken several actions in response to audit recommendations, including: 







These themes emerge from the many findings provided by Red Oak in separate audit memoranda, and 
summarized in Section 6 of the audit report. Section 6 provides a compilation of findings for each area 
of the District organization, as summarized below: 


Section 6 Findings Summary 


Organizational Area 

Strengths 

Opportunities 

for 

Improvement 

Administration 

16 

21 

Board 

2 

5 

Capital Program 
Services 

7 

8 

Chief Executive Officer 

3 

7 

Financial Services 
Division 

9 

12 

Watershed Operations 

6 

6 

Water Utility Enterprise 

7 

5 

Totals 

50 

64 


in analyzing the Red Oak findings for this document, District staff noted areas in which new or 
revised Board policies; new CEO Interpretations; new initiatives; or new ISO or administrative 
policies would be required. Staff identified one OFI as requiring new or revised Board policies 
as part of potential District implementation of recommendations. In addition, staff identified 
eight OFIs as requiring new CEO Interpretations; 16 OFIs as requiring new initiatives; and 
eight as requiring new ISO or administrative policies. OFIs identified by staff are shown in the 
tables below. 


Finding that requires a new/revised Board Policy (1) 

Admin 33 

Delegate real estate authority 

Revision of Executive Limitations policy 
needed. 


3 







measuring government affairs value. 

The auditor suggests utilizing incorrect measurement metrics and does not 
recognize that government affairs departments basically do two things for 
an organization; they attempt to increase the benefit to the organization by 
identifying opportunities in the public arena, and they attempt to reduce the 
damage to the organization from risks in the public arena. 

The recommendation should instead look to identify the value of the 
activities performed by the Government Relations Unit. As a result of 
trying to identify the value of certain activities, the Government Relations 
Unit in 2005 implemented a yearly survey of elected officials at the state 
and federal level to determine which activities, groups and tactics are 
effective in influencing their decision making. The Government Relations 
Unit has then employed those identical tactics to influence the decision 
making of elected officials and relevant staff. All of the surveyed tactics 
are reflected in the Government Relations Unit current strategic plan. 

Please see attached executive summary of a document which was 
produced by the Public Affairs Council and the Center for Public Affairs 
Management entitled “Considerations for Measuring Public Affairs’ Value.” 

The recommendation also concludes that. , if the District has not 
already done so, it should determine which of its activities could be more 
effectively or efficiently performed through an organization." What is 
suggested by the auditor is an effective model only for a very limited 
number of issues and the Government Relations Unit makes these 
determinations on an issue by issue basis. These named and unnamed 
organizations represent many members and are unable to undertake many 
lobbying efforts that do not impact the majority of their members. The 
Government Relations Unit continues to maintain a high level of 
involvement with all such relevant organizations so we can actively and 
efficiently utilize their services. 


8 






In 1999, the Board adopted an updated mission statement, which states that “The purpose of the 
Board, on behalf of the people of Santa Clara County, is to see to it that the District protects the 
public health and safety and enhances the quality of living within Santa Clara County by 
comprehensively managing water resources in a practical, cost-effective, and environmentally 
sensitive manner.” In order to accomplish this mission, the Board adopted five policies that serve 
as the District’s primary mission objectives. The objectives indicate that that District will: 

• Provide a healthy, clean, reliable, and affordable water supply that meets or exceeds 
applicable water quality regulatory standards in a cost-effective manner; 

• Manage groundwater basins to maximize water supply reliability; 

® Aggressively pursue opportunities to expand water recycling within Santa Clara 
County in partnership with other public entities as appropriate and in a cost-effective 
manner; 

® Secure the health, safety, and quality of life in Santa Clara County by carrying out a 
prudent flood management program that reduces the potential for flood damage, 
balances costs and benefits, and comprehensively addresses the expectations of the 
community; and 

• Be a steward of the watersheds in Santa Clara County to ensure that their benefits to 
the community’s quality of life are protected and, when appropriate, these benefits are 
enhanced or restored. 

The Board is supported by an Office of CEO/Board Support to assist in the Board’s oversight of 
the District’s operations towards accomplishing these objectives. This unit coordinates the 
administrative and logistical needs of the Board and acts as a liaison between the Board, the 
community, and the administration. The District also includes a Clerk of the Board office, which 
also provides general support to the Board’s operations. 

The Board of Directors has created nine advisory committees to aid the Board in policy 
development in key strategic areas. These committees are coordinated by tire Office of 
CEO/Board Support and are listed along with their stated puiposes in Exhibit 2. 
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Red Oak is mindful of the fact that the Carver Policy Governance Model has been modified by 
the District in some ways to allow for a more comfortable organizational fit. As such, we 
designed our audit to analyze the model as it is applied by the District, rather than audit the 
District against a strict interpretation of the Carver Model. 

The District also strives for continuous improvement, as highlighted by its 2005 Eureka Award 
Application for the California Awards for Performance Excellence Program, which is the State 
of California’s implementation of the Baldrige National Quality Program (Baldrige). Baldrige 
details an array of criteria to be met by effective organizations, including sets of criteria specific 
to the topics of governance and leadership. 

Red Oak’s selection of audit criteria for the Board was consistent with Generally Accepted 
Government Auditing Standards (GAGAS), which were applied in concert with our professional 
judgment to identify the most significant criteria and findings for the Board audit. 

Audit Results 


Findings 

In accordance with GAGAS, Red Oak established audit criteria for the Board, based on the 
following sources: 

• The District’s audit objectives as included in the scope of work 

• The Governance Policies of the District’s Board of Directors 

• Baldrige National Quality Program criteria, specifically, those pertaining to governance 
and leadership. 

• Our team’s collective experience with Boards of Directors and analogous governing 
bodies (e.g., City Councils, Commissions). 

Red Oak developed findings based on the fieldwork and document review described earlier in 
this memorandum. These findings are presented below according to the GAGAS fin din gs 
structure, and are designated as either “Strengths” (positive findings with no associated 
recommendation or only minor suggestions for improvement) or “Opportunities for 
Improvement” (findings with significant associated recommendations for improvement). Please 
note that the findings in this audit memorandum are not presented in any particular order, 
although they are organized according to strengths and opportunities. 

Finding No. 1 - Strength ___ 

Condition The members of the District Board have an excellent process of 

communication among board members that allows them to work well as a 
team and speak with a unified voice. Board members note that despite 
differences of opinion, the group works to maintain openness of 
communication. These communications are earned out within the limits 
proposed by the California Open Meetings Law (the “Brown Act”). 


Page 6 of 13 


October 11, 2006 






Additionally, in accordance with GAGAS, Red Oak’s project management team and audit 
leaders used their professional judgment to focus the audit on material findings and 
recommendations designed to yield the greatest potential benefit to the District. 

Overview of Audited Organization 

The District’s Chief Executive Offices consist of the Chief Executive Officer (CEO) and six 
supporting executive offices. The offices and their associated managers are listed in Exhibit 1. 
According to the District’s policy model, the Chief Executive Officer, supported by the Chief 
Executive Offices and the four operating groups, serves as the Board of Directors’ official 
connection to the operations, achievements, and conduct of the District. Specifically, according 
to the Board-CEO linkage policy adopted by the District, the CEO represents all authority and 
accountability of the staff to the Board; interprets the Board’s Ends Policies; and reports on 
progress of the District toward the Ends Policies, customer and staff treatment, financial 
planning and budgeting, financial conditions and activities, emergency CEO succession, asset 
protection, compensation and benefits, communications support, and the non-discrimination plan 
to the Board. Exhibit 1 reflects the organization of the District’s CEO level at the time of Red 
Oak’s primary audit fieldwork (August-October 2005). 


Exhibit 1 




Chief Executive Office 

Stan Williams - Chief Executive Officer 

Office of District Counsel 

Debra Cauble - District Counsel 

Office of CEO/Board Support 

Chris Elias - CEO/Board Support Officer 

Office of Government Relations 

Rick Callendar - Government Relations Manager 

Office of Ethics, Diversity, and 
Inclusion 

Gustavo De La Torre - Assistant Administrative Officer 

Office of Performance Excellence 

Peter Sakai - Chief of Performance Excellence 

Office of Communications 

Peggy Flynn - Communications/Community Relations 
Manager 


Source: Santa Clara Valley Water District, 2005 


The purpose of each of the CEO offices indicated in Exhibit 1 is discussed briefly in the 
following paragraphs. 

The Office of the District Counsel’s stated mission is to provide “high-quality, trustworthy, and 
responsive legal counsel to the Santa Clara Valley Water District in a manner that creatively 
assists in accomplishing the District's mission.” 

The Office of CEO/Board Support’s function is to support the CEO in oversight of all major 
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Additionally, Watershed Operations and the Water Utility Enterprise 
have developed their own business plans, and Administration is in 
the process of developing its business plan. Although there are 
typically references in these business plans to specific Board Ends 
Policies, there is not a District-wide strategic plan that lays out 
which programs the District will (and will not) take on in both the 
near-term and long-term. Consequently, there is not currently a 
mechanism in place to make sure that each business plan rolls up to 
the District’s mission, as well as complements the other business 
plans. As noted in the main body of the final audit report, Red Oak 
recognizes that between the time of Red Oak’s audit fieldwork and 
the finalization of these audit memoranda, the District has moved 
forward with addressing this and other recommendations in this 
audit memorandum. Red Oak has attempted to note each of these 
instances throughout the main report and these memoranda. 

Auditees indicated universally throughout the Administration audit 
(as well as the Board and CEO audits) that the budgeting process 
and level of dialogue among the Board, CEO, and managers/staff do 
not sufficiently or clearly lay out the District’s priorities for staff. A 
key challenge appears to be that initiatives such as the pursuit of a 
new management model or certification (e.g., ISO) are often rolled 
out despite not being included in the applicable budget. This is 
discussed in the main body of the final audit report. 

Effect This results in confusion regarding allocation of employee time and 

division/unit budget on not only the operating group level, but also 
the division and unit level. Unit managers and staff, although they 
are very familiar with the Board’s high-level Ends and Executive 
Limitations policies, are less clear on what the District’s and their 
priorities should be on a month-to-month or year-to-year basis. 

Recommendation As noted in the CEO audit memorandum, the District has 
historically not developed or implemented an agency-wide business 
plan, although it has a number of thorough, but department-specific 
plans. Red Oak recommends that the District develop and abide by 
such a plan, which is directly linked to annual budget development 
and adherence. Red Oak understands the District is underway with 
the development of a “CEO Work Plan,” which may address these 
issues. In any case, an agency-wide plan should spell out which 
programs and initiatives the District plans to take on (and which it 
will not, to the extent practical), how much is set aside for 
unforeseen opportunities, and what the process is for changing 
course if necessary. The annual budget should be directly reflective 
of this. 
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References: 

© Baldrige 6.2: Support Processes and Operational Planning 
® Project Management Institute — Project Management Body of 
Knowledge 

Condition The IMD has treated major ISMP initiatives like projects, with associated 

budgets, staffing plans, schedules, and risk management. However, formal 
project management is not required on all projects. Anecdotal evidence 
suggests that even project management on major initiatives may be lacking. 
For instance, it was stated that resources (i.e., staff commitment) were not 
appropriately committed to the ERP project. 

Project data (e.g., financials, schedule) are developed and stored by the 
individual project managers in the PeopleSoft project module. 

Cause There is no District requirement or management mandate that all projects 

within the IMD carry some form of formal project management. In addition, 
unit leaders may feel that many projects are too small to justify formal 
project management methodology. 

The lack of formal project management processes, in some cases, may lead 
to delays in schedule and overages on budget, as may have been the case 
with the ERP implementation. 

Effect The IMD may be missing opportunities to realize project execution 

efficiencies through formal project management. 

Recommendation The IMD should continue to focus on project management training. This 
program should be offered to staff in the ISMP Implementation Unit and 
may be performed in conjunction with other units within the District in need 
of formal project management training and processes. 

The IMD should develop an internal project management methodology that 
identifies a graduated scale for the project management requirements of a 
project based on total cost and/or relative importance to the District. For 
instance, projects of a smaller size may carry fewer requirements than larger, 
ISMP-scale projects. However, every project should carry some aspect of 
formal project management. At a minimum, this should include scope, 
budget, and schedule tracking as well as regular reporting to senior 
management. 

Based on the outcome of the operational area audits, the topic of project 
management may be developed as a District-wide finding. 
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Cause The District has been diligent in identifying and satisfying the core user 

needs within the District. This involved implementing the major systems that 
support the District’s business processes. However, the District seems to 
have stopped short of configuring or customizing the systems to automate 
some of the high-profile processes. This may be very likely due to lack of 
availability of internal resources due to other initiatives underway. 

Effect The District is still executing many processes manually by processing paper 

documents rather than automating them in existing systems. This leads to 
inefficiencies in these processes that could be eliminated by either 
configuring the processes in the IT systems or by altering processes to match 
those that are built into the IT systems. 

Recommendation The District should identify all high-usage processes that involve the transfer 
of information yet still use paper-based processes (e.g. purchase orders,) and 
develop a plan to automate these using existing systems. This plan should not 
be limited to configuration of systems, but should also include business 
process optimization to eliminate unnecessary steps. 

With respect to the CAS, the District should consider refining the tool to the 
extent it is possible to continue to achieve its original goals plus incorporate 
potential improvements identified by users to date. It is Red Oak’s 
experience that organizations who implement major new systems can benefit 
substantially from conducting a purposeful refinement after the initial 
implementation and first year of use or so, to take advantage of that initial 
experience and apply any lessons learned. 

During the finalization of this audit memorandum, District staff also noted 
that some systems such as the CAS and the budgeting tool noted in previous 
findings are currently not maintained within the Information Management 
Division. This may not pose an immediate problem, but Red Oak agrees with 
District staff that, in the long run, this will likely prove to be inefficient and 
hamper somewhat the District’s ability to fully implement some of the 
recommendations (e.g., regarding system integration) presented elsewhere in 
this memorandum. 


Finding No. 32 - Opportunity 

Key audit objective: “Information management’’ 


Criterion 

Core applications should be integrated, with automated data flows, to support 
efficient work processes. The integration methods and tools should be 
standardized. 


References: 
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Views of Responsible Officials 

“Views of Responsible Officials” are included as a component of the main body of the final audit 
report. 

Nature of Any Privileged or Confidential Information Omitted 

No privileged or confidential information was omitted from this audit memorandum. 

References 

The reference list for this and all audit memoranda is included in the main body of the final audit 
report. 
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s Review of the literature regarding generally accepted standards of financial management 
@ Individual interviews with financial services management and staff members 
9 Individual interviews with other staff members, Board members, and external 
stakeholders as deemed necessary 

@ Collection and review of documents, financial reports, and other work products as 
necessary to measure performance relative to selected criteria 

Following the fieldwork and preparation of an internal draft version of this memorandum, Red 
Oak (1) validated the preliminary findings with the Chair of the Audit Committee (also a Board 
member), and (2) presented the preliminary findings and recommendations to the Audit 
Committee on April 17, 2006. Red Oak also validated findings during multiple telephone 
meetings with the District’s Financial Services Division’s Deputy Administrative Officer, and 
provided him with a draft final version of this memorandum during August 2006 for validation 
comment. This final memorandum incorporates input provided to Red Oak during these steps. 

Per the scope of work, the Comprehensive Performance Audit was an objective and independent 
evaluation of the Board of Directors’ (Board) compliance with their Governance Policies, and 
the Chief Executive Officer’s implementation of the Board’s Ends and Executive Limitation 
Policies. To that end, the audit scope was broad (District-wide), but necessarily limited to the 
most important topics to the District as a whole. Therefore, these memoranda generally do not 
contain exhaustive assessments of any District work unit or work process. 

Red Oak maintained the focus on the District’s key issues through the systematic audit 
methodology outlined in the scope of work, which included the establishment of performance 
audit criteria per GAGAS and as demonstrated in the Findings section of this memorandum. 
Additionally, in accordance with GAGAS, Red Oak’s project management team and audit 
leaders used their professional judgment to focus the audit on material findings and 
recommendations designed to yield the greatest potential benefit to the District. 

Overview of Audited Organization 

The Financial Services Division (FSD) is part of the District’s Administration organization, 
reporting to the Chief Administrative Officer who in turn reports directly to the CEO. FSD is 
headed by a Deputy Administrative Officer assisted by an Administrative Assistant. FS consists 
of four organizational units as follows. This discussion reflects the organization of Financial 
Services at the time of Red Oak’s primaiy audit fieldwork (October 2005-December 2005). 

• Budget and Finance. This group is responsible for budget preparation, monitoring, and 
control. 

9 General Accounting. This group is responsible for accounting, billing, accounts 
receivable, and financial reporting. They are also the primary interface with the District’s 
external auditors during the amiual financial audit. 

• Treasury. This function is responsible for cash-flow management and investments. 

® Debt and Claims Management. This group is responsible primarily for debt issuance and 
management, refunding, and related activities. They also prepare claims for grant funds 
and for contributions from other entities for projects that have been undertaken jointly 
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Appendix E 


Watershed Operations Audit Memorandum 










database starts with coverage in 1979 and includes about 360 discrete 
permits. 

9 The WPMS tracks which unit/person is responsible for a deliverable. 
Unit managers receive e-mail notification when reports are due. 

« The WPMS can be accessed through the District’s intranet site. The 
regulatory compliance unit tracks the number of database users and the 
number of database hits. 

• Compliance reports generated by the WPMS show the status of 
regulatory provisions within a specified time period. Provisions may be 
“completed,” “on-target,” “delayed,” “suspended,” or “unknown.” 
Compliance reports are generated quarterly and submitted to the 
District’s Counsel’s office. Watershed Operations Deputy Operating 
Officers, and the Watershed Operations COO. 

• There is written documentation for the regulatory compliance procedure 
for Watershed Operations, which was developed under the ISO 14001 
Program (Document No. WQ84001, Revision R3). 

• As discussed in Red Oak’s audit memoranda on the District’s 
Administration organization and its Water Utility Enterprise, regulatory 
compliance with respect to Health and Safety (H&S) is a clear 
opportunity for improvement throughout the District. Watershed 
Operations is addressing H&S issues similarly to the Water Utility 
Enterprise, namely, taking a lead role in H&S program development and 
implementation given the lack of an effective centralized program at the 
District at the time of Red Oak’s audit fieldwork. 

• Watershed Operations is to be commended for making H&S compliance 
a top priority in the absence of an effective program being delivered from 
a central location within the District; however, this may not be a 
sustainable solution as discussed in the Administration memorandum. 
Specifically, H&S functions are currently resident in multiple 
organizational units within Administration and the District’s operating 
and capital groups, and it is unclear what the District’s model is for the 
provision of H&S seivices going forward. The District has formed one or 
more H&S committees made up of Watershed Operations and/or other 
operating group personnel to fill the H&S gap in Administration, 
Watershed Operations also plans to hire its own H&S program leader (as 
does WUE). This may provide a short-term remedy to address the 
District’s immediate H&S needs, but is likely neither an effective or 
efficient way of delivering H&S expertise to staff throughout the District 
on a long-term basis. A deliberate and coordinated H&S function is 
necessary; for example, a professional centralized H&S function at the 
District coupled with designated H&S coordinators in each of the 
operating groups. Regulatory compliance is nevertheless considered a 
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Appendix F 


Water Utility Enterprise Audit Memorandum 
















One clear opportunity for the WUE to build upon its existing quality 
assurance and state-of-the-industry practices is advancement to Phase III of 
the Partnership for Safe Water (PSW). The District has been in achievement 
of Phase II (“Data Collection”) for a number of years, and advancement to 
Phase III (“Self-Assessment and Peer Review”) would be consistent with its 
water treatment agency peers, logically follow from its status as one of the 
original PSW participants, and allow it to realize the benefits of nationwide 
peer review of its treatment plant operations. 

At this time, the District is currently behind its local and national peers with 
respect to the level of participation in this nationally recognized, industry- 
standard water treatment optimization program. For example, Alameda 
County Water District, Contra Costa Water District, EBMUD, SFPUC, and 
Zone 7 Water Agency have all achieved PSW “Director’s Award” status for 
one or more of their treatment plants, in some cases for five years or more, 
while SCVWD has not. Additionally, EBMUD has gone on to be one of the 
five utilities in the nation to achieve PSW “Excellence in Water Treatment” 
recognition, based on information available on the American Water Works 
Association (AWWA) website and recent AWWA publications. 


WUE Opportunity for Improvement Finding No. 1 

Related Key Audit Objectives: “Operational policies and procedures ” 

“Environmental management ” 


Criterion 

The District should have clear, measurable objectives that relate to the public 
health and safety, quality-of-life, and environmental stewardship “Ends 
Policies” adopted by its Board of Directors regarding its Water Utility 
Enterprise operations. The District should have a systematic framework for 
developing these objectives and to make the process repeatable. The 
District’s objectives in this area should be clear and consistent to internal 
staff and external stakeholders. 

References 

• Board Policy GP-1:1.1-1.3 

• Board Policy E-2: 2.1 

® Baldrige Criterion 1.2.b.l 

® Baldrige Criterion 3.l.a.2 

• Baldrige Criterion 4.1.a.l 

Condition 

The District has developed a number of objectives pertinent to the WUE 
related to its “Healthy and Safe Environment” Board of Directors Ends 
Policy (E-2). Specifically, under the overall goal of providing “...a reliable 
supply of healthy, clean drinking water,” the Board’s governance policies 
indicate objectives related to regulatory achievement, source water 
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AUDIT MEMORANDUM 


To: Alison Russell, Project Manager, Santa Clara Valley Water District 

Peter Sakai, Contract Manager, Santa Clara Valley Water District 
Larry Wilson, Audit Committee Chair 

From: Jud Warren, P.E., BCEE, Capital Program Services Audit Leader 

Todd Anderson, Project Manager 
Tom Arn, Project Officer 

Date: October 17, 2006 

Re: Comprehensive Performance Audit - Audit Memorandum 

Task 3.6 - Capital Program Services 


This memorandum presents Red Oak Consulting’s (Red Oak) findings documenting the results 
of our audit of the Santa Clara Valley Water District’s (District) Capital Program Services (CPS) 
function. Red Oak performed this audit as a component of its comprehensive Performance Audit 
of the District. This memorandum represents completion of Task 3.6 of Red Oak’s Agreement 
No. A2921A with the District. 

Introduction 

The District contracted with Red Oak to conduct a performance audit of the District. The audit 
fieldwork and this series of memoranda were structured according to the District’s organization, 
using a “top-down” approach beginning with the Board of Directors. Red Oak and the District 
recognized that many audit findings and recommendations would involve one or more 
organizational units. Therefore, these memoranda were initially presented as interim, preliminary 
drafts and remained so until the completion of the audit. Upon completion of all audit fieldwork, 
Red Oak finalized the interim findings/recommendations presented in this and the other draft 
memoranda. Therefore, this memorandum is to be considered as one component of Red Oak’s 
final audit report to the District. 

Objectives, Scope, and Methodology 

Red Oak conducted the Comprehensive Performance Audit according to Generally Accepted 
Government Auditing Standards (GAGAS). As a result, this memorandum was prepared in 
accordance with the GAGAS Reporting Standards for Performance Audits (USGAO, 2003). 
Additionally, per the scope of work, Red Oak’s audit included a review of systems and processes 
for internal controls; examination of documents and records; interviews with staff, customers, 
and stakeholders necessary to evaluate the District’s compliance with applicable laws, 
regulations, and policies; and evaluation of the effectiveness and efficiencies of the District’s 
policies, procedures, and practices for financial, administrative, and operational management, 




project-related compliance. 

Effect 

CPS does not have QMS procedures to separately document the District’s 
compliance with individual regulations; therefore, the District’s achievement 
of regulatory requirements is difficult to quickly demonstrate to internal and 
external stakeholders, unless one goes through individual project files to 
compile the information. 

Recommendation 

CPS should consider implementing a procedure and/or tool to efficiently 
document and summarize for the CEO/Board the regulatory compliance 
activities and achievements of the District’s capital improvement projects, 
due to the high level of internal and external interest in this area. The District 
may also wish to conduct periodic internal audits of its recently completed 
capital projects to ensure full regulatory compliance is achieved on a 
consistent basis. 


Capital Program Services Opportunity Finding No. 8 
Key Audit Objectives; “Operational policies and procedures ” 


“Management o f the capital program 


Criterion 

CPS should embrace a “project life-cycle” approach to planning, budgeting, 
designing, constructing, operating, and eventually retiring (if necessary) 
capital projects. Asset management tools should be used to develop standard 
life-cycle analysis procedures from which staff can develop and better 
understand cost/benefit decisions. 

Condition 

CPS’s role in a District-wide asset management effort is currently undefined. 
The project selection and prioritization process during CIP development 
considers life-cycle issues, but is not comprehensive. 

Cause 

Operating costs and useful life has historically been considered for the design 
of individual components, but not in overall project life-cycle considerations. 
Asset management at the District has been under development in the WUE, 
but there has been limited linkage with CPS in this program to date. 

Effect 

CPS continues to design well-performing projects; however, CPS could 
provide more value to the District with a more complete approach to life- 
cycle project decisions. 

Recommendation 

CPS should solicit District-wide feedback on operating conditions, 
standardized facilities, selection of materials, and life-cycle expectations to 
close any potential gap between expectations and actual delivered projects 
and increase the value of the projects that CPS builds. CPS should develop 
standards, design drawings, and specifications that incorporate project life- 
cycle analysis at the earliest possible point in the project cycle. The life-cycle 
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MEMORANDUM REPORT 


Date: June 26, 2006 

To: Mr. Larry Wilson, Chairman 

and Members of the Board of Directors 
Santa Clara Valley Water District 

From: Robert Lockridge, Principal Consultant 

Red Oak Consulting, a Division of Malcolm Pimie, Inc. 

Subject: Memo Report on Recommendations by the Santa Clara County Board of Supervisors 
Management Audit Division Regarding the SCVWD FY 2005-2006 Operating and 
_Capital Budget_ 


Purpose and Scope of this Memo Report 

This memo report has been prepared by Red Oak Consulting as part of the Comprehensive 
Performance Audit of the Santa Clara Valley Water District (“District”), currently underway. 
The District has specifically requested that we review the report issued July 12, 2005 by the 
Management Audit Division of the Santa Clara County Board of Supervisors (SCC/MAD), 
“Review of the FY 2005-06 Santa Clara Valley Water District Operating and Capital Budget.” 

The budget review report was prepared by SCC/MAD at the request of the Board of 
Supervisors in carrying out its responsibilities under the District’s enabling legislation to 
annually review and approve the District’s proposed budget. In discussion with District staff, 
we determined that, in the past, this review had been conducted at a relatively high level, and 
the submission by the District to SCC incorporated a level of detail that reflected past practice. 
This was the first year that a review at this level of detail was performed by professional staff 
reporting to the Board of Supervisors. Interviews with staff on both sides and review of related 
documents reflect a certain level of frustration that is due, we believe, to the unexpected change 
in the process. 

The purpose of our review of the document was to evaluate the recommendations therein and to 
determine whether, in our opinion, the District should take action based on those 
recommendations, in whole or in part, that would improve its financial management practices. 
We have not been asked to evaluate and express an opinion on the competence of the report or 
to provide a defense for the District regarding items that might be considered critical, and we 
have specifically refrained from doing so. Our goal, based on our instructions from the District, 
was to provide an objective, third-party point of view that would enhance the District’s ability 
to evaluate and respond to the SCC/MAD recommendations. As is hue of the Comprehensive 
Performance Audit in general, our work on this task has been conducted with the intent of 
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3. Revenues 

4. Expenditures 

5. Appropriations (Gann) Limit 

6 . Budget Reporting and Process 

The District’s response to the report, in the form of a memorandum addressed to the Board of 
Supervisors, recommends that the County consider the response and refer it for further 
consideration in the context of the Comprehensive Performance Audit. The memo also 
recommends that the Board of Supervisors adopt the FY 2005-06 District budget as originally 
presented. References to “recommendations” below are keyed to the numbered summary of 
recommendations in the SCC/MAD report. 

For purposes of our review, we have organized the SCC/MAD recommendations into the 
following categories: 


• Recommended Budget Adjustments (Table attached to SCC/MAD report cover memo). 
The SCC/MAD report recommends net budget adjustments that release approximately 
$147.7 million in resources. Of this amount, adjustments to capital projects and 
reserves account for $143.8 million. 

• Governance Issues (Recommendations 15 & 17-18). The SCC/MAD report expresses 
concern regarding the fulfillment of the Board of Supervisors’ budget review 
responsibilities and calls for a more precise definition of policies and procedures in that 
regard. The report also advises the District Board of Directors to exercise a higher 
level of budget review and control. 

• Fiscal and Budgetary Management Approaches and Policies (Recommendations 4, 8, 

9, 14, & 16). The SCC/MAD report recommends in general that the District take a less 
conservative approach in establishing reserves and projecting personal services 
expenditures and should confirm its current level of salaries and benefits through a 
third-party market review. In addition, it suggests that there should be a redirection of 
reserved resources to address an unfunded liability due to post-employment health care 
benefits. 

• District Budget and Planning Process (Recommendations 1-3, 5-7, & 10-13 . The 
SCC/MAD report recommends a number of revisions to the District’s budget process, 
primarily focusing on providing sufficient information on a timely basis to allow the 
Board of Supervisors to appropriately conduct its review. The report also makes 
recommendations regarding the frequency of budget reporting to the Board of 
Directors. 

The remainder of this memo report outlines our evaluation of the SCC/MAD 
recommendations in each of these areas. In all cases, we have considered the District’s 
response to the SCC/MAD report, but have formulated our own independent opinion based 
upon our review of the facts and circumstances as we understand them. 


Recommended Budget Adjustments (Table attached to SCC/MAD report cover 
memo). 



PATHWAYS TO LASTING SOLUTIONS 




Task 2.3 Assumptions 


Meetings: 1 total 
Interviews: 0 

Deliverables: 1 memorandum delivered electronically, 1 
work plan/schedule, audit tools 


V S24;639 : 


2.3 Audit Planning and Methodology Workshops 

Meeting: Planning Session with core Consultant and District team members 

• Discuss involvement of District bargaining groups (Engineers’ Society, 
Employees’ Association, Mid-Management Group) 

• Discuss roles and responsibilities of Consultant and core District team 
members 

Make final adjustments to audit work plan and/or tools if necessary 
Task 2.4 Assumptions 

Meetings: 1 half-day meeting 
Interviews: 0 

Deliverables: Detailed audit work plan 


Progress Milestone 2.4 ; ; 


$6,453 


2.5 Audit Work Plan Revisions 


2.5.1 Review current Audit Work Plan, budget status, and schedule status at the 
conclusion of Tasks 3.1 (Board Audit) and 3.2 (CEO Office Audit). If necessary, revise 
Audit Work Plan, budget, and/or schedule to incorporate findings and any adjustments to 
approach. 

2.5.2 Review current Audit Work Plan, budget status, and schedule status at the 
conclusion of the Administration Section Audit, Task 3.3. If necessary, revise Audit 
Work Plan, budget, and/or schedule to incorporate findings and any adjustments to 
approach. 
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9 Imported water agreements 
9 Contracts with water retailers 

• Decision process for water purchase activities 

• Agreements with the Regional Water Quality Control Board and/or 
Santa Clara County regarding groundwater cleanup oversight 

® AWWA or other water conservation best practices 
® District’s water supply permits 

• Water quality standards and internal goals such as the District’s 
Partnership for Safe Water goals 

• Select critical criteria for audit 

• Establish appropriate timeframe to be audited 

• Determine how the condition will be measured for comparison to criteria and 
how conclusions will be validated with District representatives 

• Prepare audit instruments and detailed work plan 

• Conduct internal and client review, revise 



3.4.4 Conduct audit fieldwork/deskwork 

® Execute specific audit tasks and draft findings for each 
« Conduct up to 8 individual interviews, consisting of interviews of the 5 

individuals listed below, plus up to 3 additional managers from the second list 
below. The 3 additional interviewees will be selected based on the outcome of 
the initial 5 interviews and the critical criteria identified in Task 3.4.1.3: 

Initial Task 3.4.4 Interviewees (5) 
o Water Utility COO 

o Water Utility Planning, Finance, and Communication Unit Manager 

o Water Supply Management Deputy Operating Officer 
o Imported Water Unit Manager 

o Water Utility Operations Deputy Operating Officer 

List of Possible Additional Task 3.4.4 Interviewees (3) 
o Groundwater Cleanup Oversight Programs Unit Manager 
o Water Use Efficiency Unit Manager 

o Operations Planning & Analysis Unit Manager 
o Groundwater Management Unit Manager 

o Water Quality Unit Manager 

o Laboratory & Environmental Services Unit Manager 
o Water Utility Engineering Unit Manager 

o Utility Maintenance Unit Manager 

o Utility Treated Water Operations Unit Manager 
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List of Acronyms 


H&S 

Health and Safety 

IBB 

Interest-Based Bargaining 

IBMR 

Informal Board Member Request 

IBNR 

Incurred But Not Reported 

ICMA 

International City/County Management Association 

IMD 

Information Management Division 

ISMP 

Information Systems Master Plan 

ISO 

International Standards Organization 

ISSC 

Information Systems Steering Committee 

IT 

Information Technology 

MOU 

Memorandum of Understanding 

NFIP 

National Flood Insurance Program 

NIMS 

National Incident Management System 

NPDES 

National Pollutant Discharge Elimination System 

OC 

Office of Communications 

OCBS 

Office of the CEO/Board Support 

OCE 

Operations Council on Excellence 

OEDI 

Office of Ethics, Diversity, and Inclusion 

OES 

Office of Emergency Services 

OMB 

Office of Management and Budget 

OPE 

Office of Performance Excellence 

PERS 

Public Employees Retirement System 

PMRS 

Performance Measures Reporting System 

PSW 

Partnership for Safe Water 

QA 

Quality Assurance 

QMS 

Quality Management System 

RIMS 

Response Information Management System 

RMA 

Risk Management Administrator 

SCADA 

Supervisory Control and Data Acquisition 

SCC/MAD 

Santa Clara County’s Management Audit Division 

SCVURPPP 

Santa Clara Valley Urban Runoff Pollution Prevention Program 

SCVWD 

Santa Clara Valley Water District 

SEMS 

Standardized Emergency Management System 

SFPUC 

San Francisco Public Utilities Commission 

ssv 

Sustainable Silicon Valley 

SWP 

State Water Project 

SWPPP 

Storm Water Pollution Prevention Plan 

WBS 

Work Breakdown Structure 

WEF 

Water Environment Federation 

WO 

Watershed Operations 

WPMS 

Watershed Permit Management System 

WRIS 

Water Resources Information System 

WUE 

Water Utility Enterprise 
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3. Project Goal, Scope, and Methodology 


3.1. Project Goal and Scope 


Per the scope of work, the District Board of Directors’ (Board) overall goal of engaging 
Red Oak to conduct this Comprehensive Performance Audit was to obtain an objective 
and independent evaluation of the Board’s compliance with their Governance Policies, and 
the Chief Executive Officer’s implementation of the Board’s Ends and Executive 
Limitation Policies. To that end, the District and Red Oak worked together to develop an 
audit scope that was broad (District-wide), but necessarily limited to the most important 
topics to the District as a whole. Therefore, Red Oak’s interim audit memoranda and this 
final report do not contain exhaustive assessments of any District work unit or work 
process, but rather focus on the District’s fundamental governance, leadership, 
management, and execution "strengths” and "opportunities for improvement,” as 
described later in this section. The scope of work developed jointly by the District and Red 
Oak before the commencement of the audit is presented in Appendix K. 


3.2. General Project Methodology 


Red Oak maintained the focus on the District’s key issues by adhering to the systematic 
audit methodology outlined in the scope of work and described briefly here. Red Oak 
conducted the Comprehensive Performance Audit according to Generally Accepted 
Government Auditing Standards (GAGAS). A key feature of the audit methodology was 
the establishment of performance audit criteria per GAGAS and as demonstrated in the 
Findings sections of the appended interim audit memoranda. Additionally, in accordance 
with GAGAS, Red Oak’s project management team and audit leaders used their 
professional judgment to focus the audit on material findings and recommendations that 
will yield the greatest potential benefit to the District. 

As a result, the appended interim audit memoranda and this Summary Audit Report were 
prepared in accordance with the GAGAS Reporting Standards for Performance Audits 
(USGAO, 2003). Per the scope of work, Red Oak’s audit included a review of systems and 
processes for internal controls; examination of documents and records; and interviews 
with staff, customers, and stakeholders necessary to evaluate the District’s compliance 
with applicable laws, regulations, and policies. Red Oak also evaluated the effectiveness 
and efficiencies of the District’s policies, procedures, and practices for financial, 
administrative, operational, and capital planning and management. 

GAGAS defines a structured approach to auditing that is designed to “ensure competence, 
integrity, objectivity, and independence” in “planning, conducting, and reporting” audit 
work. Performance audits are one type of audit that can be conducted under GAGAS, and 
are defined as an “objective and systematic examination of evidence to provide an 
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Section 9 

Baldrige Category 3 - Customer and Market Focus 


Addressing the above could improve the District’s ability to respond to Baldrige criteria 
Item 3.1 as it pertains to giving consideration to customer groups, market segments, and 
the various customer requirements of those groups and segments. Further, understanding 
the various customer groups and market segments could lead to an improved capacity to 
meet the standards set for Baldrige Result Item 7.3. While Red Oak recognizes and has 
documented the numerous individual strengths within the District pertaining to customer 
knowledge and incorporation, a fully deployed, District-wide approach would enhance the 
District’s ability to demonstrate “process maturity” (in Baldrige terminology) with respect 
to understanding and incorporating the needs of its customers. 

The District should develop a clear vision and mission specific to external communication, 
and implement it throughout the organization. The District has done significant work 
already in the area of customer identification and incorporation; however, this has been 
done in a somewhat fragmented manner and there is not yet a clear and thorough agency¬ 
wide identification and definition of the District’s customer groups or a plan for 
relationship maintenance and management with these groups. 

Developing a cohesive, agency-wide communications strategy is an exercise that the 
District should undertake at the governance/leadership level. Such an effort should not be 
constrained or influenced by existing department/unit responsibilities. When this vision 
and mission is developed, the CEO (in conjunction with the executive team) can 
communicate them through the District as appropriate, and decide how best to ensure that 
the District’s communication efforts are internally aligned. This will also present a good 
opportunity for the District to ensure that the District’s immediate customers and other 
high-priority recipients of District information are adequately addressed in the District’s 
communication efforts. Although it is likely that implementation of the District’s 
communications vision and mission will encompass many units, specifically those with 
significant customer interaction, all significant communication materials should be 
coordinated with the Office of Communications prior to publication to best coordinate 
messages and stakeholder communication opportunities. 


9.2. Department-Level Communications and Customer Focus 


The Water Utility Enterprise, Watershed Operations, and Capital Program Services are 
primary examples of individual operating groups’ strengths in customer relations. The 
Water Utility Enterprise has taken a number of important steps with respect to 
incorporating its customers’ needs in the services it provides, including developing 
comprehensive internal and external customer lists for all its units, establishing regular 
water retailers’ committees and subcommittees, and incorporating customer feedback into 
its operations. There are a number of areas for customer-oriented improvement within the 
Water Utility Enterprise, including more formal recognition of and relations with 
individual domestic well owners, improved internal coordination with the District’s in- 
house laboratory resources, and further recognition of other local entities (e.g., Santa 
Clara County, the City of San Jose) as “partners” in its delivery of services to the 
community with shared objectives. (See also Appendix F - Water Utility Enterprise Audit 
Memoranda Finding No. 2.) 
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10. Baldrige Category 4 - Measurement, 
Analysis, and Knowledge Management 


The Baldrige program defines “measurement, analysis, and knowledge management” as 
“How [an] organization selects, gathers, analyzes, manages, and improves its data, 
information, and knowledge assets, and how [an] organization reviews its performance. ” 

The discussion below is based primarily on individual audit findings presented in the 
Administration, Watershed Operations, Water Utility Enterprise, and Capital Program 
Services audit memoranda appended to this report. 


10.1. Information Management 


It is essential that the District consistently provide employees with the tools necessary to 
realize the mission of the District. This includes all information management tools 
necessary to effectively handle the District’s knowledge assets. These assets include 
inventory management tools, document management tools, mapping tools, and tools to 
manage high-usage processes. Each of these categories is discussed below. 

10.1.1. Information Systems Master Plan 

To manage information assets, the District developed an Information Systems Master Plan 
(ISMP) in 2001. The District should update the ISMP for use as an information systems 
strategic plan. Using “lessons learned” from the PeopleSoft implementation and other 
ISMP projects, the District should develop a plan for its IT projects over the next three 
years and determine budgets, schedules, and dedicated staff requirements. This update of 
the ISMP should reflect the implementation to date based on the 2001 ISMP and take into 
consideration the interdependencies on other IMD and District-wide projects/initiatives. 
This update should also directly support a District-wide strategic plan. 

Addressing this area could enhance the District’s ability to maintain performance 
measurement systems current with business needs and organizational direction, as 
described in Baldrige Criteria Item 4.1. The linkage between this criterion and the strategic 
plan can be found in Note 3 of Item 4.1. 


The ISMP should target major process integration at a district-wide level. To date, the 
District has not fully integrated major systems in a way that would be expected of a top¬ 
performing large water agency. Instead, the District seems to have taken a “point-to- 
point” approach to integration rather than a standardized platform for enterprise 
integration involving commonly accessible data stores or a centralized messaging bus. In 
the case of CMMS-ERP ( Maximo-PeopleSoft ), the District has integrated the inventory 
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Section 10 

Baldrige Category 4 - Measurement, Analysis, and Knowledge Management 


process, timesheet system) and implementing a District-wide document management 
system. This emphasis could lead to better organization of knowledge management, which 
is evaluated by Baldrige criteria Item 4.2. 


10.2. District-wide Asset Management Effort 


The District is to be commended for having the key ingredients of an effective asset 
management plan in place within its Water Utility Enterprise, as evidenced by verbal and 
documented information provided to Red Oak, specifically: 

• A well-developed utility asset inventory; 

• Well-developed condition-rating methodology and results; 

• Integration (currently underway) of its local surface water system and treated 
water asset databases; 

• Staff charged with ownership of the overall asset management program within the 
Water Utility Enterprise; 

• Appropriate Computerized Maintenance Management System (CMMS) software 
in use to facilitate effective asset management; and 

• An Annual Maintenance Plan to guide each year’s maintenance activities 
according to system priorities and planned asset needs. (Formerly, maintenance or 
engineering services were requested and delivered according to individual work 
orders.) 

However, like most of its peers, the District and the Water Utility Enterprise have a 
number of significant additional steps necessary before asset management is fully 
functional agency-wide and able to be carried out over the long term. There are currently 
different asset management/database systems and methodologies in place across the 
agency, and while most organizational areas recognize the need for asset management, the 
District has no long-term plan regarding how to accomplish this goal. For example, within 
Watershed Operations, life-cycle replacement costs for watershed facilities are generally 
not known. Best practices in this area for flood/watershed management entities are limited, 
which will require that the District develop new methods for this analysis. As discussed 
during Audit Committee meetings, this is therefore an example of a “stretch” (challenging) 
goal the District may want to take on. As noted in the Water Utility Enterprise audit 
memorandum appended to this report, the District is well-positioned to build on its 
accomplishments to date in the area of asset management. For example, staff have a strong 
working knowledge of the asset management programs in place among its agency peers, 
the type of knowledge that will be important to take advantage of in light of the potential 
human and financial resource constraints noted later in this section. 

Capital Program Services has also recognized the need for asset management and has 
published its Capital Improvement Plan (CIP) to address it, but has not yet made the 
commitment to a District-wide effort. Red Oak found that Capital Program Services could 
improve its project delivery by embracing a “project life-cycle” approach to planning, 
budgeting, designing, staffing, constructing, operating, and eventually retiring (if 
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Section 12 

Baidrige Category 6 - Process Management 


Some procedures remain undocumented, largely due to the need to update and adopt 
procedure documents and manuals that were developed and used prior to the adoption of 
ISO methods. Nevertheless, the District as a whole is ahead of its peers in terms of 
documentation of administrative and technical procedures. As a result, it is able to 
demonstrate its standard procedures to interested parties and to readily train newly hired, 
laterally transferred, or promoted staff. 

The seventh Baidrige category, focusing on business results, is not presented in this 
summary report because the applicable District audit findings are covered in the previous 
six Baidrige sections of this report and the individual findings in the appended Financial 
Services interim audit memorandum. 

This and the previous sections of this audit report synthesize Red Oak’s individual findings 
as presented in the appended memoranda, focusing on what Red Oak determined to be the 
most significant, highest-value, and cross-organizational findings and recommendations 
from our audit throughout the District. All individual findings are provided in the 
appended audit memoranda, and summarized in the Section 6 table. 
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Mr. Todd L. Anderson 
Page 2 

February 15, 2007 


Additional District actions in response to the Red Oak audit, as well as areas of disagreement 
with the findings, are noted in the attached document. 


Sincerely, 






Stanley IV)< Williams 
Chief Executive Officer 


Attachment 

cc: Mr. Tom Am, Red Oak Vice President 

Board of Directors (7) 

O. Martin Steele 


ar:yw:mf 
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Section 14 
Personnel 


Ron Ralcich 
Jim Scholl, P.E. 

Denise Shields 

Peter Talbot, P.E. 
Robert Warren, P.E. 
Michael Wertz 
Mauricio Zepeda, P.E. 


Administration Auditor (Risk Management) 

Watershed Operations Audit Leader 

Quality Assurance Reviewer (Audit Criteria, Baldrige 
Incorporation) 

Board of Directors Auditor 

Capital Program Services Audit Leader 

Board of Directors and Chief Executive Offices Auditor 

Water Utility Enterprise Audit Leader 
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policies, procedures, and practices for financial, administrative, and operational management, 
and capital planning and management. 

The key audit objectives for the Board of Directors audit provided to Red Oak by the District 
were as follows, as indicated in Task 3.1 of the scope of work: 


• “Evaluate the effectiveness and efficiency of the Board of Directors’ oversight of the District, 
including: 

o Adherence to their governance process policies 

o Adherence to their Board-CEO linkage policies, including the effectiveness of the 
Board methods and practices for monitoring CEO performance 
o Board composition, size, and methods for electing/appointing Board members 

• Identify other special districts with elected officials whose budgets are approved by another 
level of government” 


The fieldwork for the Board of Directors audit consisted of the following components: 

• Document reviews 

• Individual interviews with Board members 

• Individual interviews with selected external stakeholders of the District 

• Individual interviews with the District’s CEO and selected members of the District’s 
Executive Leadership Team 

• Attendance at a selected Board meeting 

• Questionnaires completed by Board members and the District’s CEO/Executive 
Leadership Team participants 

Following the fieldwork and preparation of a draft version of this memorandum, Red Oak (1) 
validated the preliminary findings with the Chair of the Audit Committee (also a Board 
member), and (2) presented the findings and recommendations to the Audit Committee on 
October 11, 2005. This final memorandum incorporates input provided to Red Oak during these 
two steps. 

Per the scope of work, the Comprehensive Performance Audit was an objective and independent 
evaluation of the Board of Directors’ (Board) compliance with their Governance Policies, and 
the Chief Executive Officer’s implementation of the Board’s Ends and Executive Limitation 
Policies. To that end, the audit scope was broad (District-wide), but necessarily limited to the 
most important topics to the District as a whole. Therefore, these memoranda generally do not 
contain exhaustive assessments of any District work unit or work process. 

Red Oak maintained the focus on the District’s key issues through the systematic audit 
methodology outlined in the scope of work, which included the establishment of performance 
audit criteria per GAGAS and as demonstrated in the Findings section of this memorandum. 
Additionally, in accordance with GAGAS, Red Oak’s project management team and audit 
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Effect 

The Board does not have an effective way to redress issues of effectiveness 
or propriety of other Board members or the overall body. The process of 
simply revisiting policy is insufficient because it does not allow the Board to 
address root causes of an issue in a systematic and team-building manner that 
will reinforce teamwork and collaboration, and provide an avenue for on¬ 
going monitoring of change. 

Recommendation 

The Board should establish a standard process for self-evaluation and 
assessment that strengthens their ability to work as a team, communicate, and 
work within the framework of their existing policies. The Board should also 
consider retaining an outside advisor to coach them on the elements of 
continuous improvement at a board governance level. If it is deemed 
practical, the Board may also want to consider a process of capturing 
external stakeholder and/or CEO input to further enhance its self- 
assessments. 

Finding No. 5-0 

pportunity 

Criterion 

The Board should have a formalized process to ensure that both incoming 
and current Board members undergo orientation and regular continuing 
professional education as appropriate, to ensure the sustainability of their 
governance process. 


Reference: 

• Board Policies: GP-2.5, GP-4, GP-7.5, and GP-10.1.1 
® Baldrige Senior Leadership: 1.1 a(3) 

• Baldrige Governance and Social Responsibilities: 1.2a(2) 

Condition 

The District is to be commended for having adopted a formal, written 
governance model and using it to optimize communications between the 
Board and staff. However, the Board has an opportunity to improve the 
sustainability of then adopted model, and to maximize its value. Although 
the current Board members are highly experienced and participate in training 
and professional development opportunities on their own, the Board does not 
have an established training process to help ensure that the Board continues 
to be a well-trained governing body over the long term. 


Establishing such a process would ensure that both current and future 
members receive regular and systematic professional education/training to 
strengthen their knowledge and understanding of the District’s policy 
governance model, as well as developments in areas such as public agency 
finance, and governance skills and tools. Any negative impact of a lack of a 
training and orientation program has been limited due to the high level 
experience of current Board members; however, the sustainability of the 
Board’s effectiveness may be hampered as new members are elected or 
appointed. 
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District functions, including his responsibility to the Board. This office also coordinates the 
District Board’s nine advisory committees. These committees are listed and discussed in more 
detail in the interim audit memorandum Red Oak has prepared regarding the Board. 

The Office of Government Relations is responsible for influencing water-related policies and 
regulations on the local, state, and federal levels that may affect the District. This involves 
political outreach efforts, including having a presence in both Sacramento, California and 
Washington, D.C., using consultants to complement District staff. 

The Office of Ethics, Diversity, and Inclusion’s (OEDI) mission statement includes enhancing 
District employees’ work-life quality, and promoting an inclusive workforce based on respecting 
and valuing individual differences. The District’s goal for these efforts is to improve staff 
productivity and increase the value of the District’s services to the community. OEDI’s efforts 
include the management of staff cultural programs and the development of the District’s 
Diversity Strategy and Diversity Master Plan. 

The goals of the Office of Performance Excellence (OPE) are to provide staff support to the CEO 
and District managers/staff in the planning and implementation of organizational improvement 
initiatives; and to lead projects including performance measurement and management, strategic 
planning processes, and performance/program evaluations. The OPE staff also serve as internal 
consultants and information resources to District managers and staff on organizational process 
improvement. 

The Office of Communications’ (OC) mission is to provide the link between the District Board 
and the community; facilitate stakeholder input and support for District construction projects; 
strengthen partnerships with the community and other stakeholders; perform integrated 
marketing and development; and distribute the District’s key messages. The OC serves as the 
District’s principal liaison to media and develops outreach to educate and engage the public. 

As noted in the interim audit memorandum Red Oak has prepared regarding the Board, the 
District is governed in accordance with the tenets of the Carver Policy Governance Model. This 
model is characterized by key departures from the traditional board and CEO model of 
governance. Some of the critical elements of the District’s application of the model include: 

• The Board develops “ends” and “limitation” policies for the CEO. The CEO is then 
expected to create a strategy to accomplish the ends within the given limitations. 

° The performance of the CEO is regarded as identical to the District’s performance. 

e The Board relies upon the CEO’s interpretation of the Board’s policy directives in 
order to accomplish the ends. Such reliance is predicated on the strong leadership and 
effective communication of the CEO. 

Red Oak is mindful of the fact that the Carver Policy Governance Model has been modified by 
the District in some ways to allow for a more comfortable organizational fit. As such, we 
designed our audit to analyze the model as it is applied by the District, rather than audit the 
District against a strict interpretation of the Carver Model. 
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outsourcing-based business solutions can be difficult in a 
bargaining-unit environment. Nevertheless, it is a characteristic of 
high-performing organizations to periodically assess their functions 
and make such decisions based on business/cost-based criteria. 


Cause 

Considering and implementing outsourcing of non-core activities 
when appropriate is standard practice in private industry, and is 
becoming more common for public agencies. The District, through 
hiring of key individuals from the private sector with outsourcing 
experience, and through the willingness of its managers to be open 
to creative cost-saving opportunities, has initiated the process of 
outsourcing auto parts and has reached a point where managers can 
make informed decisions about the economic consequences of the 
use of in-house versus vendor services for many reprographics 
services. 

Because outsourcing to specific vendors can be more cost-effective 
and result in increased focus on the core business at a given 
organization, it is typically a reasonable tradeoff to invest the initial 
staff hours and budget on the relevant cost-benefit analyses. 

Effect 

If implemented, it appears that the outsourcing of the auto parts 
function at the District will result in significant cost savings for the 
District. Based on the progress of this effort to date, the District is 
considering analyzing the pros and cons of outsourcing of other non¬ 
core functions (e.g,, equipment management at its water treatment 
plants). This may result in additional opportunities to control costs 
and/or focus staff on the District’s primary functions. The District 
may wish to compile a list of any additional potential outsourcing 
opportunities, decide whether performing an in-house vs. external 
cost/benefit analysis is warranted, and/or identify any challenges to 
implementation. 


Finding No. 4 - Strength 

Key audit objective: N/A _ 

Criterion The District’s organizational structure should ensure that 

accountability for specific Administration functions clearly resides 
in identifiable organizational units. Not only should job 
responsibilities of a given unit be clear to the District employees 
within that unit, other District staff (the unit’s internal customers) 
should be aware of the services provided by any given unit. The 
organization should be structured to enable the optimal delivery of 
Administration’s services to the rest of the District. 
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The development of such an agency-wide plan should be led by the 
CEO and carried out in conjunction with his Executive Leadership 
Team. Specific to this audit memorandum, development of the 
Administration plan should ensure it is in alignment with this 
District-wide plan, that is, that its activities directly support the 
achievement of the organization’s objectives, and that it is not 
conducting activities that do not directly support the organization’s 
goals. The CEO should be accountable to the Board for executing 
the activities set forth in the plans, and for ensuring that the District, 
to the extent possible, does not expend resources conducting 
unplanned or peripheral activities. 


Finding No. 8 - Opportunity 
Key audit objective: N/A 


Criterion 

Project or program planning efforts should fully support the 
District’s strategy to achieve its mission and include all necessary 
functional areas, to maximize the efficiency with which 
projects/programs are implemented, and to minimize schedule 
delays or “surprises” as projects/programs are carried out. 

References: 

• Baldrige — 2.1: Strategy Development 

• Baldrige -6.2: Support Processes and Operational Planning 

Condition 

District planning efforts have historically not always included the 
necessary Administration support functions. 

For example, based on information provided to Red Oak to date, 
planning for District capital projects that involve the acquisition of 
real estate and/or rights of way typically do not involve the Real 
Estate Unit until late in the process. Late requests and insufficient 
time for action result in the increased need to use legal proceedings 
for the District to acquire rights-of-way and the potential for 
increased costs and project delays. 

Red Oak was provided with an internal memorandum from the Real 
Estate Unit from 1988 on the exact problem as is being experienced 
today. This underscores the structural and/or cultural challenges at 
the root of this problem. 

It is important to note that this apparent lack of inclusion of support 
functions from Administration in capital project planning is not 
universal - the risk management function is typically included as 
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Finding No. 10 - Strength 

Key audit objective: “Risk management/insurance costs 


Criterion 

Individual claims should be reserved using appropriate case-based 
practices and procedures. 


References: 

® Board Policy EL- 7 (7.2): Asset Protection 
« GASB Statement No. 10 

Condition 

The District is to be commended for its claim reserve practices. Since 
all estimates of total liabilities, including estimates for losses that have 
occurred but are not yet known, are based on individual claim reserves, 
reserving practices are important. The District uses the services of a 
third-party administrator for managing workers’ compensation claims 
including settlement and case reserving, which is typical and 
appropriate for an agency of its size and function. For liability claims, 
the District’s Risk Management Administrator (RMA), in consultation 
with District Counsel, sets individual case reserves. Reserves are based 
on judgment of the individuals. 

Cause 

Individual case reserving is a requirement of excess insurers and is an 
activity so ingrained in claim management as to be a standard practice. 
The District has placed a priority on conducting its reserving practices 
accordingly. 

Effect 

Because estimated ultimate costs of individual claims are established 
by claim adjusters (workers’ compensation) and by the RMA in 
conjunction with legal counsel (liability), total loss-year costs are 
developed and projected by the consulting actuary so that proper 
recognition of liabilities occurs. 


Although Red Oak was not made aware of any instances where actual 
claims have exceeded reserves, the District may want to consider (if it 
hasn’t done so already) explicitly encumbering the funds that are set 
aside for future claims to ensure that they will be ready for use if 
necessary. Also, Administration and District Counsel should ensure 
that the relationship with the RMA is clearly and properly defined so 
that the authority and responsibility to make claims management 
decisions related to tenders of defense, selection of counsel, and the 
handling of settlement discussions best serves the interests of the 
District. This also relates to Finding No. 14 in this memorandum 
regarding who has the authority and responsibility to administer claims 
and lawsuits that are received (e.g., who selects counsel and how they 
are managed, who makes decisions on settlements). 
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Condition 

The District has several written documents governing the usage of the IT 
resources, system security, and user privacy. Most notable are the “Ad-7” 
series of Administrative Policies and Procedures, specifically, “Ad-7.2 - 
Computer and Electronic Communication Support Services.” The IMD also 
has several other documented procedures, including a Computer/Network 
Employee Separation Policy and Procedure, and disaster recovery plans for 
the organization as a whole and one specifically for PeopleSoft. 

Cause 

The IMD has taken deliberate measures to document its procedures for the 
benefit if its own staff as well as the organization as a whole. 

Effect 

The IMD staff has developed and follows a set of formal written guidelines 
to follow when performing activities related to system security (e.g., 
disconnecting former employees). This assures that activities are performed 
in a consistent manner and human errors are minimized. 

The IMD has informed District employees of their responsibilities and 
limitations when using District IT resources, including computers, the 
network, and the two-way radio system. This helps to minimize downtime 
and any inappropriate use of District resources. 


Finding No. 21 - Strength 

Key audit objective: “Information management ” 


Criterion 

The IMD should have an updated annual plan and budget, with appropriate 
budget categories to directly support the District’s mission, strategic business 
plan, and budget. In addition, categories should reflect dominant activities, 
such as network operations, user support, system implementation, 
communications charges, software maintenance fees, and other service fees. 
Actual labor and expenses should be tracked against the budget. 

References: 

• Board Policies EL-4 & EL-5 

9 Baldrige 6.2: Support Processes and Operational Planning 

Condition 

The IMD develops an annual business plan that summarizes each unit’s 
budget within the Division for the coming year. Also summarized are major 
project activities, ongoing support and maintenance activities, and individual 
training plans. Each unit’s budget is broken out into ongoing operations and 
capital projects. Budgets are also rolled up into financial account numbers. 
(As noted in numerous other findings, however, this annual business plan has 
historically been developed in the absence of a District-wide plan and or an 
Administration- wide business plan. Red Oak understands that both 
documents are currently under development. The IMD tracks budget against 
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accountability, and fiduciary role that is not directly related to their 
achievement of operating objectives. 

Cause 

The District’s general absence of direction or priority on integrating financial 
considerations at a high level in the organization have required that Financial 
Services focus primarily on basic accounting, financial reporting, and 
transaction processing. 

Recommendation 

Under the direction of a CFO, plans should be developed for including 
Financial Services participation in more proactive support of the District’s 
strategic activities. While it is difficult to precisely measure the adequacy of 
staffing in a financial management function, Red Oak’s impression from 
interviews and examination of documents indicates that Financial Services’ 
current staffing level may not be adequate to undertake this assignment. A 
comprehensive staffing and workload evaluation should be undertaken as 
noted in other audit memoranda, and in light of the recommended direction 
for the financial function at the District. 

FINDING 5.1(a) 

Criterion 

GAO Practice 5: Maximize the efficiency of day-to-day accounting activities, 

GAO Practice 5, Key Point 1. Inefficient processes are eliminated or 
streamlined. 

GAO Practice 5, Key Point 2. Transaction-processing activities are 
consolidated, standardized, and reengineered at shared-service centers. 

GAO Practice 5, Key Point 3. The cost and benefits of outsourcing 
routine accounting activities are considered. 

The District should exhibit these GAO Practice characteristics. 

Condition 

No systematic process of evaluating processes and improving efficiency, 
including consideration of outsourcing routine transaction processing, has 
been developed. 

Effect 

Top management has no basis for evaluating the efficiency of basic 
transaction processing and financial accountability/fiduciary responsibility 
functions. 

Cause 

Without a strategic plan for the financial function, there is no framework 
within which to establish such a system of evaluation. 
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Financial Services and the Office of Performance Excellence should work 
with administrative managers to establish efficiency and effectiveness 
measures for their activities. 

FINDING 10.1(a) 

Criterion 

GAO Practice 10: Develop a finance team with the right mix of skills and 
competencies. 

GAO Practice 10, Key Point 1. A defined set of technical management 
and leadership skills and competencies is developed as part of the entity’s 
overall approach to strategic human-capital planning and is used as a 
foundation for all human-capital management activities and decisions. 

GAO Practice 10, Key Point 2. Training and career development 
programs use both classroom instruction and rotational assignments. 

GAO Practice 10, Key Point 3. Opportunities to “learn the business” are 
provided. 

The District should exhibit these GAO Practice characteristics. 

Condition 

The District has been successful in developing a team that fits the business 
processes required by its operating goals and objectives. For example, a debt 
manager has been employed, reflecting the capital-intensive nature of the 
District’s businesses and the consequent need for debt financing. Business 
units in the operating departments have been effective in responding to the 
needs of operating managers for financial support. 

This appears to have been primarily an ad-hoc process. There is no formal 
plan for achieving the appropriate set of skills and competencies for the 
District’s long-term needs, and there are some gaps. For example, there is a 
need for a manager skilled in the financial oversight, management, and 
reporting of capital expenditures for major projects. 

Effect 

The District has a solid team of financial professionals capable of providing 
all fundamental services in that area. 

Cause 

This appears to be the result of a clear emphasis on basic accountability and 
fiduciary responsibility by the Board and CEO. In addition, operating 
department managers have demanded support from financial professionals, 
resulting in the establishment of the business units. 

Recommendation 

Financial Services should work with HR to develop a formal comprehensive 
organizational and staffing plan, establish appropriate position descriptions, 
identify required skills, knowledge and abilities, and determine what gaps 
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AUDIT MEMORANDUM 


To: Alison Russell, Project Manager, Santa Clara Valley Water District 

Peter Sakai, Contract Manager, Santa Clara Valley Water District 
Larry Wilson, Audit Committee Chair 

From: Jim Scholl, P.E., Watershed Operations Audit Leader 

Donna Bodine, Watershed Operations Auditor 
Tom Am, Project Officer 

Date: October 11, 2006 

Re: Comprehensive Performance Audit - Audit Memorandum 

Task 3.5 - Watershed Operations 


This memorandum presents Red Oak Consulting’s (Red Oak) findings documenting the results 
of our audit of the Santa Clara Valley Water District’s (District) Watershed Operations 
organization. Red Oak performed this audit as a component of its comprehensive Performance 
Audit of the District. This memorandum represents completion of Task 3.5 of Red Oak’s 
Agreement No. A2921A with the District. 

Introduction 

The District contracted with Red Oak to conduct a performance audit of the District. The audit 
fieldwork and this series of memoranda were structured according to the District’s organization, 
using a “top-down” approach beginning with the Board of Directors. Red Oak and the District 
recognized that many audit findings and recommendations would involve one or more 
organizational units. Therefore, these memoranda were initially presented as interim, preliminary 
drafts and remained so until the completion of the audit. Upon completion of all audit fieldwork, 
Red Oak finalized the interim fmdings/recommendations presented in this and the other draft 
memoranda. Therefore, this memorandum is to be considered as one component of Red Oak’s 
final audit report to the District. 

Objectives, Scope, and Methodology 

Red Oak conducted the Comprehensive Performance Audit according to Generally Accepted 
Government Auditing Standards (GAGAS). As a result, this memorandum was prepared in 
accordance with the GAGAS Reporting Standards for Performance Audits (USGAO, 2003). 
Additionally, per the scope of work, Red Oak’s audit included a review of systems and processes 
for internal controls; examination of documents and records; interviews with staff, customers, 
and stakeholders necessary to evaluate the District’s compliance with applicable laws, 
regulations, and policies; and evaluation of the effectiveness and efficiencies of the District’s 
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® Include estimates of current year financial results, including fund balances, in the ' 

proposed budget, and update those estimates based on new information during the 
budget process. I 

® Include an analysis of labor costs by position and functional area in the proposed ' 

budget. 

® Present more complete quarterly financial management reports. j 

« Ensure approval by the District Board of key planning documents. 

• Provide key planning documents to the Board of Supervisors on an annual basis. , 

I 

' 

These are reasonable suggestions that the District should consider in the context of cost of 
implementation and the expected value to be achieved. 

We encourage conformance of the budget calendar to the County’s needs, as already agreed to 
by the District. 

The proposed budget would be greatly enhanced by up-to-date estimates of current year 
results, including fund balances. If there is a high level of uncertainty, the estimates can be 
made on a conservative basis. 

L- 

In the context of the District’s governance structure, we do not agree that a detailed 
distribution of labor costs by position would add significant value to the District Board’s 
deliberations. This is a matter better delegated to the CEO, who is then held responsible for 
achieving Board-mandated performance results. 

As we stated earlier, it is important that material deviations from the Board-approved budget 

be reported on a quarterly basis. Authority to make those changes in the first instance 

appropriately resides with the CEO under the District’s adopted governance model. i 


It is our observation that key planning documents are developed through a process that 
includes broad community and District committee participation, that Board members fully 
participate in that process and are knowledgeable regarding District plans, and that the Board 
is provided with key planning documents. Since these documents are public records, provision 
to the Board of Supervisors is clearly appropriate. 
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Financial Services Audit 

District Staff 


Joseph Atmore, Debt Finance Officer 
Najon Chu, Unit Manager, Financial Services 
Ronald Mayorga, Budget Services Officer 
Peter Ng, DAO, Financial Services 
Jean Ruth, Treasury Officer 

External Interview 


Steve Foti, Auditor, Santa Clara County Management Audit Division (Harvey M. Rose 
Accountancy Corporation) 

Watershed Operations Audit 

Neddal Ali-Adeeb, Unit Manager, Watershed Business Management 
Don Arnold, Unit Manager, Ecological Services 

Jason Christie, Unit Manager, Lower Peninsula/West Valley Watershed Program 
Support 

Shree Dharasker, Unit Manager, Regulatory Compliance 
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Task 2.5 Assumptions 

Meetings; 0 
Interviews: 0 

Deliverables: 2 Revised Audit Work Plans 



3.0 Performance Audit 

3.1 Board of Directors 

Key audit objectives: 

Evaluate the effectiveness and efficiency of the Board of Directors’ oversight of the 
District, including: 

• Adherence to their governance process policies 

• Adherence to their Board-CEO linkage policies, including the effectiveness of 
the Board methods and practices for monitoring CEO performance 

• Board composition, size, and meth ods for electing/appointing Board members 

Identify other special districts with elected officials whose budgets are approved by 
another level of government 

3.1.1 Develop plan and schedule for background research 

3.1.2 Conduct background research 

• Review documents 

• Review recent Board meeting minutes 

• Attend Board meeting 

• Interview Board chairman and Audit Committee chairman to obtain insight 

3.1.3 Develop audit approach 

• Identify potential audit criteria, including Carver model and Baldrige criteria 

• Select critical criteria for audit 

• Establish appropriate timeframe to be audited 

• Determine how the condition will be measured for comparison to criteria and 
how conclusions will be validated with District representatives 

• Prepare audit instruments and detailed work plan 

• Conduct internal and client review, revise 
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3.3.6 Risk Management Program 

3.3.6.1 Develop plan and schedule for background research 

3.3.6.2 Conduct background research 

• Review documents, including business planning (goals, objectives, 
approaches, action plans, etc), policies and procedures, workload 
and performance statistics, and organizational “charter” 

3.3.6.3 Develop audit approach 

• Identify potential audit criteria, including Carver model, Baldrige 
criteria, District ordinances, Board governance policies, and GASB 

• Select critical criteria for audit 

• Establish appropriate timeframe to be audited 

• Determine how the condition will be measured for comparison to 
criteria and how conclusions will be validated with District 
representatives 

• Prepare audit instruments and detailed work plan 

• Conduct internal and client review, revise 

3.3.6.4 Conduct audit fieldwork/deskwork 

• Conduct 1 interview 

• Review District ordinances and procedure manuals 

• Review reserving practices 

• Review actuarial reports 

• Review insurance programs 

• Execute other specific audit tasks and draft findings for each 

• Review findings in field with those directly involved, if possible, 
and document feedback 

3.3.6.5 Prepare memorandum of findings 

• Prepare draft for internal team review 

• Revise and review with appropriate client representatives 
(validation meeting) 

• Finalize memorandum of findings 

Task 3.3.6 Assumptions 

Meetings: 1 total (1 validation meeting) 

Interviews: 1 individual interview 
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2. Introduction 


In May 2005, the Santa Clara Valley Water District (District) contracted with Red Oak 
Consulting, a division of Malcolm Pirnie, Inc. (Red Oak) to conduct a comprehensive 
performance audit of the District. This is the final “Summary Audit Report” per Task 4.2 
of Red Oak’s scope of work, and therefore represents completion of Red Oak’s services 
under Agreement No. A2921A with the District. 

Red Oak conducted the audit fieldwork and prepared a series of seven interim audit 
memoranda according to the District’s organization, using a “top-down” approach 
beginning with the Board of Directors. At the outset of the project, Red Oak and the 
District recognized that many audit findings and recommendations would involve one or 
more organizational units—in fact, one of the key expectations of the District was that 
Red Oak would look at key business functions across organizational lines. Red Oak 
submitted the interim memoranda to the District as preliminary drafts throughout the 
project, and this report represents Red Oak’s review and finalization of the interim 
findings and recommendations presented in the seven draft memoranda to date. 

The District has built a reputation as an agency focused on top-quality service to the 
community, effective governance and leadership, and continuous improvement. Its desire 
to undergo this performance audit is one manifestation of this. Red Oak has conducted 
this performance audit, and designed this Summary Audit Report, to satisfy all 
requirements in the audit scope of work, as well as provide the District with a useful tool 
to help build on its existing successes and further improve its effectiveness and efficiency. 
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Section 8 








Section 8 

Baldrige Category 2 - Strategic Planning 



District to gain knowledge from other entities that have best-practice-level strategic 
planning processes in place. 


As noted earlier in this section, between the time of Red Oak’s audit fieldwork and the 
preparation of this final report, the District reported to Red Oak that it had moved 
forward with reconciliation of its existing strategic planning efforts in addition to 
development of a “CEO Work Plan” to address the opportunities for improvement noted 
in this section. 
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Section 9 

Baldrige Category 3 - Customer and Market Focus 


for customers to ask for unreasonable levels of service. Red Oak understands that the 
District is already underway with an Administration -wide customer feedback mechanism 
to build upon its existing collection of unit-specific efforts. 


9.3. Customer and Market Focus Summary 


Overall, Red Oak found good progress throughout all areas of the District in terms of 
customer outreach, customer feedback mechanisms, and incorporation of customer 
feedback. Similar to District efforts with strategic planning, however, this effort is 
generally piecemeal and inconsistent throughout District departments. The District could 
benefit from defining a District-wide vision and mission in the area of customer service 
and applying the Carver Policy Governance Model to ensure this vision/mission is 
addressed in Board policies, CEO interpretations, and the day-to-day activities of the 
District units and staff. Furthermore, the District should consider systematically surveying 
its key customers and high-priority stakeholders across its operational levels to gain 
feedback on its operations, maintain positive relationships, and solicit external feedback 
on opportunities for improvement from those who rely directly on its services. Currently, 
this is performed at an enterprise-specific level, but could be strengthened with additional 
cohesion and coordination. An agency-wide strategic business plan is, again, a key link in 
this regard—specifically, the District can apply feedback gained from its customer survey 
activities (both internal and external) directly into its current and future opportunities via 
its strategic planning process. 
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12. Baldrige Category 6 - Process Management 


The Baldrige program defines “process management” as “ key aspects of [an] 
organization’s process management, including key product, service, and business processes 
for creating customer and organizational value and key support processes. This category 
encompasses all key processes and work units. ” 

The discussion below is based primarily on individual audit findings presented in the 
A dminis tration, Watershed Operations, Water Utility Enterprise, and Capital Program 
Services audit memoranda appended to this report. 


12.1. Policies and Procedures: Documentation and 
Implementation 


Red Oak found that the usability and comprehensiveness of policies and procedures ranges 
among District divisions. Within Administration, approximately 90% of the units have 
policies and procedures in place while other departments are not yet at this standard. The 
District routinely involves its three employee bargaining units in the development of draft 
policies and procedures. Obtaining this input during the development phase helps promote 
employee ownership of, and compliance with, policies and procedures. 

Although policies and procedures exist for nearly all units and ownership of the policies 
and procedures is clear, the District’s process to implement the procedures and enforce 
compliance is unclear. 

In some cases, Administration staff are put in the position of interpreting Board policy or 
CEO interpretations as compared to simply following existing rules and fulfilling their 
professional administrative “service provider” support role to the operating functions of 
the District. This is consistent with Red Oak’s interim audit finding as presented in the 
appended Board of Directors memorandum that there is ambiguity among management 
staff regarding the CEO’s interpretations of Board policy. Furthermore, auditees 
consistently expressed frustration with the ambiguity of many of the policies and 
procedures, particularly noting that many of them have been in continual revision for the 
past several years. District management understands that policies and procedures are a 
critical tool for internal control. However, the District has not made priorities of ensuring 
the specificity of policies and procedures, and designating who is responsible for 
interpreting and/or enforcing of the policies when necessary. Based on the success of ISO 
certification in Watershed Operations and Capital Program Services, District-wide 
certification could improve the current status of these policies. 

Often Administration units struggle between the role of the “policy enforcer” and the 
“corporate service provider.” According to some internal customers, Administration staff 
require these customers to exceed requirements promulgated by the Board and/or CEO. 
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Environmental Stewardship 

Plan-Do-Check-Act 

The District's Vision, identifying the 
environment as a customer, and ISO 14001 
registration all demonstrate commitment to 
environmental stewardship. 

Has not been deployed. 

Process Metrics 

Demonstrated strong, positive levels and 
trends in results related to product and service 
outcomes. 

Scorecard Implementation 

Needs to be further deployed. 

Treatment of Staff Survey 

Not effective. 

Customer-Focused Outcomes 

Predominantly indirect rather than direct 
measurement of satisfaction. 


GRAND JURY REPORT 2006 

Strengths 

Areas for Improvement 

Commendable iob of providina water, 

Voters fail to participate in District director 

protectina watersheds, and implementing 

elections 

flood control 

The District is a complex agency with a wide- 
ranging and critical mission. 

Directors may not represent a broad 
area/section of the population. 

Board of Supervisors relationship 

Should be a model for oversight of other 
independent special districts in the county. 

No District Board Members should be appointed 
Currently, directors appointed by Board of 
Supervisors participate in decision-making 
without mandate from voters. 

Efforts to emphasize manaaement and quality 

Projects and expenditures not always supported 

standards 

Applauded by Grand Jury. 

by the public or retail distributors 

Leads to heated public debate about the scope 
and efficiency of operations. 

Capital Project Process 

Water rates have increased sianificantlv over 

Process used to identify, prioritize, fund, 
develop, and construct capital projects is 
systematic and thorough, but it is also lengthy 
and complex involving multiple jurisdictions, 
regulatory requirements, and funding from 
other government agencies. 

time 

Rate differentials between north and south 
county are difficult to understand. 
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From 1999 to the present, the District has continued to develop its performance 
measurement practices, including establishment of the Office of Performance Excellence 
and implementation of performance measures throughout the organization. During 2004, 
the District prepared its initial Baldrige assessment/application and received valuable 
feedback from the CAPE program in return. The District subsequently began using the 
“Balanced Scorecard” approach, a method of performance measurement focusing on four 
perspectives of an organization’s performance tied to its vision and strategy: financial, 
business process, learning and growth, and customer. 

The District tailored the Balanced Scorecard approach to yield its current “CEO 
Scorecard” approach, which incorporates the Balanced Scorecard perspectives, but is 
structured largely according to the following six Baldrige categories: Leadership; 
Strategic Planning; Customer and Market Focus; Measurement, Analysis, and 
Knowledge Management; Human Resource Focus; and Process Management. At this 
time, the District is selectively migrating its former Performance Measures Reporting 
System (PMRS) measures into the CEO Scorecard framework, which will be 
implemented using PB Views software. The CEO Scorecard is designed to be used by the 
District to measure its progress according to its vision of becoming “Cleaner, Greener, 
and Leaner.” 

The District’s current scorecard as shown in its 2005 CAPE application is provided 
below. The District’s performance measurement process in general, and this scorecard 
specifically, are described more fully in Section 2 (Strategic Planning) of the District’s 
July 2005 CAPE application. 


Mi ssion 

he mission of the District is a healthy, safe ami enhanced quality of Jiving 
in Santa Clara County through watershed stewardship and the 
comprehensive management of water resources in a practical, cos/ 
effective and environmentally sensitive manner 


Vision 

Getting Cleaner, Greener, and leaner 


3 .d.u.cts.and. 
Services 




Clean Index ) f 
(30%) J 


Custamacs. 


2,1 Consumer 
Satisfaction 
(40%) 
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Elnancial and 
Market 


H u m an / rirnani-.aHnnai V l eader s h ip 

Res ponsibility 




i 


( 3.1 Unit Cost N ( 

J \ (30%) J \ 


4.1 Work Force /' 5.1 Lean Index 

Strength (40%) J \ (30%) 


\ { 6.1 Regulatory 
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>reen Index 
(3 0%) 


■/ l ’Y 4 ' 26 sK' m x' t ) 
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ex (30%) 


X 

an Space 
is (Public ) { 


2.3 Board 
Satisfaction 
(15%) 


. /' 3.3 Net 

? ( Operating 
' \ Surplus (20%) 


\ ( 4.3 Safety Index \ / S.3 Risk Index 

J (15%) / V - 


(20%) 


6.3 Social 
Responsibility 
Index (20%) 


2.4 Partner "\ p' 3.4 Investment A 
Satisfaction 1 i Performance } 
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APPENDIX C 
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CONSULTING 
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AUDIT MEMORANDUM 


To: Alison Russell, Project Manager, Santa Clara Valley Water District 

Peter Sakai, Contract Manager, Santa Clara Valley Water District 
Larry Wilson, Audit Committee Chair 

From: Tom Arn, Project Officer 

Todd Anderson, Administration Audit Coordinator 

Date: October 11, 2006 

Re: Comprehensive Performance Audit - Audit Memorandum 

Task 3.3 - Administration 


This memorandum presents Red Oak Consulting’s (Red Oak) findings documenting the results 
of our audit of the Santa Clara Valley Water District’s (District) Administration functions. Red 
Oak performed this audit as a component of its Comprehensive Performance Audit of the 
District. This memorandum represents completion of Task 3.3 of Red Oak’s Agreement No. 
A2921A with the District. 

Key personnel from Red Oak’s team for this audit included Todd Anderson, Scott Castelli, 
David Harris, and Jennifer Hoyle (Red Oak Consulting); Jim Fimiegan (Universal Field 
Services); Debby Lu (Lux Consulting); and Ron Rakich (Ron Rakich and Associates). Our 
senior review team for this audit memorandum included Eileen Goodwin (Apex Strategies), 
Robert Lockridge (Red Oak Consulting), Bob Maddow (Bold, Polisner, Maddow, Nelson & 
Judson), and Denise Shields (Shields Resource Group). 








April 17, 2006. Red Oak provided the CAO with a draft final version of this memorandum 
during August 2006 for validation comment. This memorandum incorporates input provided to 
Red Oak during all of the above steps. 

Per the scope of work, the Comprehensive Performance Audit was an objective and independent 
evaluation of the Board of Directors’ (Board) compliance with their Governance Policies, and 
the Chief Executive Officer’s implementation of the Board’s Ends and Executive Limitation 
Policies. To that end, the audit scope was broad (District-wide), but necessarily limited to the 
most important topics to the District as a whole. Therefore, these memoranda generally do not 
contain exhaustive assessments of any District work unit or work process. 

Red Oak maintained the focus on the District’s key issues through the systematic audit 
methodology outlined in the scope of work, which included the establishment of performance 
audit criteria per GAGAS and as demonstrated in the Findings section of this memorandum. 
Additionally, in accordance with GAGAS, Red Oak’s project management team and audit 
leaders used their professional judgment to focus the audit on material findings and 
recommendations designed to yield the greatest potential benefit to the District. 

3. Overview of Audited Organization 

The District’s Administration organization is composed of the Office of the Clerk of the Board, 
the Administration Business Management Unit, the Risk Management Program Unit, and five 
divisions: Administrative Services, Financial Services, Information Management, Human 
Resources, and General Services. As noted above, this memorandum includes Red Oak’s 
findings based on audits of all of the above except Financial Services (included in a separate 
memorandum). Based on information provided by the District, below are brief descriptions of 
the general purposes of the major units and divisions responsible for the work processes and 
topics addressed in this memorandum. This discussion reflects the organization of 
Administration at the time of Red Oak’s primary audit fieldwork (November 2005-March 2006). 

Office of the Clerk of the Board: The stated mission of the Office of the Clerk of the Board is 
to maximize public access to the citizens of Santa Clara County in accordance with the State of 
California’s Ralph M. Brown Act (Brown Act) and provide services in a timely manner to the 
Board of Directors, District staff, and the District’s customer base. The Office of the Clerk of the 
Board is responsible for enabling public access to minutes, actions, and notifications of the 
District’s Board of Directors and related committees. In addition, the Office of the Clerk of the 
Board assists the Board of Directors in accomplishing the legislative process through regulatory 
filings; research; coordinating the Conflict-of-interest Code Program, Directors’ budgets, and 
expenses; and managing relevant database systems and the Public Facilities Finance Corporation. 

Administration Business Management Unit: The Administration Business Management Unit 
functions in a similar manner to other District business units, with services such as the 
management of budget issues, position requests, and space allocations. The unit also serves as a 
strategic resource to Administration management and the CAO, to whom unit staff report 
directly. Typically focusing on Administration- and District-wide initiatives, Administration 
Business Management Unit staff often coordinate the efforts of many divisions, units, and 
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reserving practices. Furthermore, an audit of claims could also identify 
whether claims are being closed/settled/litigated within best-practice 
timeframes. The sooner claims are addressed, the lower the cost to the 
District is likely to be. Using this process for workers compensation 
claims helps increase accuracy of reserving and thereby provides for 
more accurate financial statements and budget stability. Lack of a 
formal review procedure for liability claims could mean that these 
benefits of independent review are not being obtained for liability 
claims. 

Recommendation 

While the relatively low number of liability, claims in the District 
probably precludes the need for a formal audit on a frequent basis, a 
periodic independent review of certain individual cases by an 
experienced and independent liability claims professional can offer 
benefits to the District, including external validation of the District’s 
practices. 

Liability claims, unlike workers’ compensation claims, can vary 
widely in magnitude. Reserving errors on individual claims likely will 
have greater effect in this line of coverage than in others. While the 
District appears to have an excellent record for valuing and settling 
claims within estimated settlement value, an analysis of the process 
every five years or so, consisting of a review of open claims and an 
equal number of closed claims, could validate the effort and provide 
assurance to the District that its liability claims processes are 
appropriate. 


7. Human Resources Findings 


Finding No. 16 - Opportunity 

Key audit objective: “Management of human resources 


Criterion 

Implementation of the District’s Health and Safety (H&S) program 
should be consistent with industry standards and regulations. In 
addition, the health and safety program should be clear and 
accessible to all District employees. 

References: 

a Board Policy EL-3 

* Baldrige -5.3: Employee Well-Being and Satisfaction 

Condition 

Recently, a third-party review commissioned by the District 
highlighted several key areas where the District’s Health and Safety 
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Recommendation 


requirements are not being met leads to a decline not only in the 
H&S program, but also management’s credibility among District 
employees. This finding relates closely to Finding No. 7 in this 
memorandum related to the District’s need to establish priorities 
according to a District-wide strategic business plan. 


A required program function like H&S deserves top priority. Action 
must be taken when management becomes aware that it is not 
appropriately staffed or otherwise not meeting its program goals. 

The District should re-focus on basic compliance in the area of H&S 
in order to maximize the credibility of the program among District 
staff and ensure the health and safety of its workforce. Moreover, 
the District should quickly initiate and establish a health and safety 
program with a consistent organizational structure from year to year. 
This will require a commitment from the CEO, Chief Administrative 
Officer, and/or Deputy Administrative Officer of Human Resources 
to ensure that hiring of the necessary individual(s) is made one of 
the District’s top priorities. The District should also prioritize 
resolution of any OSHA non-compliance issues it currently faces. 

The District should also consolidate and centralize Health and 
Safety functions within a single unit to achieve basic compliance, 
coordinate activities, and more closely evaluate program 
effectiveness. This should be done in a concerted manner so that any 
compliance functions currently being achieved by the operating 
groups not be lost in the consolidation. One option for the District to 
accomplish this is through consolidating the H&S program under the 
Risk Management Unit, although this would require a significant 
addition to the existing unit’s mission and resources. Traditionally, 
H&S and loss control are subsets of the risk control field under the 
risk management function. 

A structure that might be optimal for the District is an H&S 
department that places control and responsibility for basic 
compliance issues such as introductory training and basic safety 
awareness within H&S, and places the responsibility for advanced 
job-specific training and field compliance in the hands of the unit 
managers. The H&S department would verify that training has taken 
place, and would support the unit managers in this regard. However, 
it would leave job-specific matters in the hands of the first-line field 
supervisors or other appropriate operations staff. In addition to 
typically being an efficient and effective distribution of 
responsibilities, it helps to foster agency-wide “ownership” of health 
and safety activities and compliance, as compared to something that 
is perceived to be a single individual’s or single unit’s sole 
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demonstrate the reason for its current staffing levels. Red Oak 
understands that the District’s two most recent budget documents 
(FY 05-06 and FY 06-07) are more explicit regarding the agency’s 
staffing levels over time and their relation to programmatic goals 
and services provided to the community. 

Recommendation 

The District should continue with its efforts to replace or 
complement its historical case-by-case request-based staffing 
methodology with a more comprehensive effort to align human 
resources with business need across the organization. This should be 
directly tied to the District’s agency-wide strategic business plan. In 
other words, the District would benefit from examining its staffing 
levels for the entire organization, because it is apparent that staffing 
levels have not historically been correlated with service levels. The 
District would likely also benefit from dialogue to raise awareness 
among its stakeholders regarding its human resource levels and the 
link between them and District goals and activities. Addressing 
other recommendations in this and other memoranda (e.g., 
addressing potentially redundant or parallel functions in 
Administration and the operating groups) will also contribute to 
overall efficiency and management of staffing levels. Red Oak also 
understands the District is considering, or already implementing, 
other actions to consider staffing levels agency-wide and build on 
the analysis it has conducted during its last two annual budget 
cycles. 


Finding No. 19 - Opportunity 

Key audit objective: “Management of human resources ” 


Criterion 

The District should have in place a hiring prioritization process to 
enable managers to expedite hiring based on degree of position 
importance/urgency to the core business of the District. 

References: 

• Board Policy EL-3 (3.6) 

9 Baldrige — 5.1(c): Work Systems — Hiring and Career 
Progression 

Condition 

Based on Red Oak’s review of the District’s policies and 
procedures, and based on consistent verbal information from 
auditees, the District has not historically employed any prioritization 
process to distinguish between vacant positions in terms of urgency 
of the need to replace the position. 
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actuals using the PeopleSoft Financial System.) 

Cause 

The IMD has taken deliberate measures to codify its budget, project plans, 
and training plans into an annual business plan. 

Effect 

The IMD tracks actual expenditures against its annual budget. This 
comparison is used to steer projects and expenses during the year so that the 
overall budget is maintained. The annual plan also empowers individuals to 
implement their own training plans and take responsibility for their 
completion. 


Finding No. 22 - Strength 

Key audit objective: “Information management” 


Criterion 

The District should conduct a periodic review of IT skills and staffing required 
to effectively manage its current and near-term portfolio of hardware, software, 
and implementation projects. An annual training and development budget for 
staff should be established and there should be training objectives for 
individuals. 

References: 

® Baldrige - 2.2. a. 4: Key human resource plans based on strategic 
objectives and action plans 

• Baldrige - 5.2: Employee Learning and Motivation 

Condition 

The IMD develops an annual business plan that summarizes each unit’s 
organizational structure and individual training plans. As part of this business 
plan development exercise, the IMD also estimates its staffing needs. Training 
plans are based on identified skill needs. The District budgets 40 hours per 
person per year for training activities. 

Cause 

The IMD has taken deliberate measures to formally define its training plans for 
each staff person. 

Based on Red Oak’s audit activities, IMD has a more fully developed training 
program than most other areas of the District. Red Oak understands that 
historically, the central training and organizational development functions at 
the District have been involved in District-wide training efforts (e.g., ethics 
training, common software application training) and not in unit-specific 
training. However, a District Training Master Plan is under development. Red 
Oak may develop this finding further and/or change it into a District-wide 
finding depending on the outcome of the operational area audits. 

Effect 

As a result of having formal training plans and adequate budget, most IMD 
staff are satisfied with their opportunities to improve their skills. A further 
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leadership of the organization. This has limited the District’s ability to 
comprehensively measure the District’s operational efficiency, and its ability 
to integrate financial concerns into policy setting and long-term strategic 
business planning. 

Cause 

Financial leadership has responded to current Board policies and CEO 
interpretations, which emphasize executive limitations and basic 
accountability and fiduciary responsibility. Lack of a strong voice for 
financial management at the CEO conference table has resulted in an absence 
of advocacy for an expanded role for finance. 

Recommendation 

An important first step in improving the District’s focus on financial 
management as an “entity-wide priority” would be the creation of a CFO 
position reporting directly to the CEO. This position should be described and 
staffed to enable the District to have a CFO focused “upward” and participate 
in agency-wide leadership and strategic matters, and maintain a foundation 
of accountability and control with the Financial Services Division. The 
position should be open for internal and external applicants. 

As noted in the previous finding, Red Oak understands that since the time of 
this audit fieldwork, the District has moved forward with elevation of the 
financial function in the organization, along with creating a closer 
organizational link between financial and performance management. These 
steps directly address a number of Red Oak’s recommendations in this and 
related audit findings. 


FINDING 3.1(a) 


Criterion 

GAO Practice 3: Use training to change the organizational culture and 
engage line management. 

GAO Practice 3, Key Point 1. Non-financial managers are educated about 
the financial implications of business decisions. 

GAO Practice 3, Key Point 2. Training and tools are provided to 
facilitate and accelerate the pace of change initiatives. 

The District should exhibit these GAO Practice characteristics. 

Condition 

There is no systematic approach to educating and training non-financial 
managers (including the CEO and the Board) in general financial concepts, 
the basic financial dynamics of the District, and techniques of financial 
analysis applicable to the specific business decisions confronting them. 

This has likely contributed to a lack of a common understanding among 
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processes should be executed centrally. There should be formal technical 
review of financial activities (e.g., rate-setting) by qualified management in 
the central finance function. 


FINDING 7.1 (a 


Criterion 




GAO Practice 7: Develop systems that support the partnership between 
finance and operations. 

GAO Practice 7, Key Point 1. The general ledger system is integrated 
into business processes and is adequate for financial reporting and 
control. 

GAO Practice 7, Key Point 2. Automated systems are designed and 
deployed that (1) accurately measure the costs of activities, processes, 
products, and services and (2) provide line managers with timely, 
accurate financial and non-fmancial information on the quality and 
efficiency of business processes and performance. 

GAO Practice 7, Key Point 3. An enterprise-wide system integrates 
operating, financial, and management information and allows decision 
makers to access relevant information easily and perform ad-hoc data 
analysis. 

The District should exhibit these GAO Practice characteristics. 


Condition 

The District recently acquired a well-established automated enterprise 
accounting system. Although there were some initial implementation 
difficulties, the system is now integrated into the business processes of the 
District. Financial reporting and control have been successfully carried out 
using the new system. 

Implementation of ancillary operational support systems such as cost 
accounting, integration with the work-order system, and timekeeping for 
treatment plant staff seems to have lagged behind. The operating business 
units have made some progress in developing cost-accounting functionality 
in the system. 

Effect 

Support of operating activities with financial information is rudimentary. 

Cause 

Financial Services has no clear objective for this level of support. 

Recommendation 

The District should, through a CFO, integrate this sort of support and system 
development into a strategic plan for the District’s finance function. 
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Per the scope of work, the Comprehensive Performance Audit was an objective and independent 
evaluation of the Board of Directors’ (Board) compliance with their Governance Policies, and 
the Chief Executive Officer’s implementation of the Board’s Ends and Executive Limitation 
Policies. To that end, the audit scope was broad (District-wide), but necessarily limited to the 
most important topics to the District as a whole. Therefore, these memoranda generally do not 
contain exhaustive assessments of any District work unit or work process. 

Red Oak maintained the focus on the District’s key issues through the systematic audit 
methodology outlined in the scope of work, which included the establishment of performance 
audit criteria per GAGAS and as demonstrated in the Findings section of this memorandum. 
Additionally, in accordance with GAGAS, Red Oak’s project management team and audit 
leaders used their professional judgment to focus the audit on material findings and 
recommendations designed to yield the greatest potential benefit to the District. 

Please note that although there are some cost-related findings presented in this memorandum, the 
majority of Red Oak’s findings in response to the “cost” and “overhead” key audit objectives 
noted above are presented separately in Red Oak’s audit memorandum on the District’s financial 
services functions. 

Overview of Audited Organization 

The District’s Watershed Operations organization executes the flood protection and watershed 
management portion of the District’s stated mission to provide for “a healthy, safe, and enhanced 
quality of living in Santa Clara County through watershed stewardship and comprehensive 
management of water resources in a practical, cost-effective, and environmentally sensitive 
manner.” 

Watershed Operations is organized into three divisions per the geographical watersheds managed 
by the District: the Lower Peninsula/West Valley Watershed Division, the Coyote and 
Uvas/Llagas Watershed Division, and the Guadalupe Watershed Division. Each division has an 
engineering unit and a field operations unit. Watershed Operations has two units in charge of 
major business management and planning: the Office of Watershed Planning and the Watershed 
Business Management Unit, which lead the following efforts: leadership and strategic planning, 
customer/partner and market focus, management analysis and business results, human resources 
focus, process management, and information technology and knowledge focus. In addition, 
Watershed Operations has five units to manage functions across all three watersheds: the 
Vegetation Management Unit, the Stream Water Quality Unit, the Regulatory Compliance Unit, 
the Community Project Review Unit, and the Ecological Services Unit. This discussion is 
reflective of Watershed Operations’ organization at the time of Red Oak’s primary audit 
fieldwork (May-July 2006). 

Watershed Operations is currently undertaking a 15-year stewardship program called the Clean 
Safe Creeks and Natural Flood Protection Program. Funding for this program, approved by 
Santa Clara County voters in 2000, includes a $39/year special tax. 
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effective nor efficient way of delivering the necessary expert H&S services 
to staff throughout the District on a long-term basis. A deliberately organized 
and coordinated H&S function is necessary at the District, for example, a 
professional centralized H&S function coupled with designated H&S 
coordinators in each of the operating groups. 

As noted in the main body of the final audit report, the District reported to 
Red Oak that it had made significant advances in the H&S area between the 
time of Red Oak’s audit fieldwork and Red Oak’s preparation of the final 
audit report and finalization of this and the other individual audit 
memoranda. Specifically, the District has hired an agency-wide H&S 
program leader, and is moving forward with addressing the issues noted 
above. 




Auditees reported that other regulatory activities within the WUE, including 
discharges of treated water to the environment, requirements at the treatment 
plants for chemical storage tanks, hazardous materials/waste, spill 
prevention, and storm water pollution prevention are generally handled well, 
and that roles and responsibilities are clear in this area, although Red Oak 1 
could not substantiate this with the document review process. 

Despite the H&S challenges noted above, regulatory compliance is still 
considered a “strength” for the WUE for the purposes of this audit 
memorandum. The H&S issue is noted here because it represents a workload 
and coordination issue for WUE staff as evidenced by verbal information 
provided by auditees and significant H&S program development activities 
within the FY 2006 WUE Business Plan. 


The WUE has placed a priority on supporting the District’s mission and its 
Board’s Ends Policies that relate to drinking water quality, environmental 
stewardship, and regulatory compliance in general. The WUE has 
established appropriate roles and responsibilities for ensuring regulatory 
compliance into the future. The District participates in the PSW, a national 
program designed to drive surface water treatment plant agencies to 
optimize their unit processes and deliver finished water of higher quality 
(specifically, lower turbidity) than required by regulations. The District is 
now making an effort to formalize and document its areas of going above 
and beyond regulatory compliance, as shown in the District’s draft CEO 
Work Plan. 


The WUE allows the District to achieve or exceed its goals regarding 
compliance with state and federal drinking water regulations, thereby 
delivering on its stated mission and Ends Policies regarding the quality of 
life and the provision of safe drinking water in Santa Clara County. 
Documentation and measurement of the District’s WUE regulatory 
performance as suggested by the District’s draft CEO Work Plan will enable 
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the District to more clearly demonstrate its performance to internal and 
external stakeholders. 


WUE Strength Finding No. 2 
Related Key Audit Objectives: N/A 
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The District is to be commended for striving for and maintaining a very high 
level of service reliability, as well as engaging its retail customers in its 
discussions and determinations regarding its reliability objectives, which is 
closely related to the District’s Water Infrastructure Reliability Project noted 
in the FY 2006 WUE Business Plan. Although Red Oak was not provided 
with documents to substantiate this, consistent information from auditees 
indicates that the District has entered into dialogue with its retailers 
regarding level-of-service alternatives and the respective responsibilities of 
the District and the retailers for the reliability of service provided to the 
ultimate customer. 

Cause 

The District has placed a priority on creating specific and measurable 
objectives regarding water supply reliability, and on engaging its direct 
customers in level-of-service determinations. This focus is further 
manifested in the current draft of the CEO Work Plan. 

Effect 

The WUE/District’s focus on defining its level of reliability in specific and 
measurable tenns affords managers, staff, and key customers a consistent 
understanding of the District’s reliability objectives, and enables them to 
conduct their activities accordingly. The District should continue with its 
proactive dialogue with its retailers concerning system reliability and level 
of service expectations, and consider incorporating the outcome of these 
discussions into its retailer contracts to the extent appropriate. 


WUE Strength Finding No. 4 

Related Key Audit Objectives: “Operational policies and procedures ” 

“Compliance with state and federal regulations ’’ 
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level and technical areas of the District’s consultant utilization, but also (2) 
set forth how District staff manage and measure the performance of 
consultants. 


References 

a Board Policy E-4: 4.2.1 
@ Board Policy EL-3: 3.7 
• Baldrige Criterion 6.2. a. 4 

Condition 

The District does not have a stated policy regarding the use of consultants to 
support WUE’s operations, as evidenced by consistent responses from 
auditees and a review of WUE’s policies and procedures, and this is typical 
for the District’s peer agencies. Unit managers report that consultants are 
used primarily when specialized expertise is necessary, and occasionally 
because of workload/capacity issues. Based on input from auditees, the 
WUE, for example, as a matter of course, always hires consultant external 
resources to perform its Environmental Impact Reports (EIR); however, this 
policy is not formalized or documented. Red Oak’s review of the District’s 
consultant contract list indicates use of consultants across the District’s 
business areas. 


Unit managers generally report that they are able to manage the scope, 
budget, schedule, and overall performance of the consultants they hire; 
however, the WUE documents provided to Red Oak did not include any 
consultant performance tracking tools or similar procedures in place for 
doing so. 

Cause 

The District, like most of its agency peers, has historically relied on a 
combination of in-house resources and external resources, including 
consultants, to perform its activities. The Board’s Executive Limitation 
policies provide a general District policy that the use of in-house resources is 
to be maximized before external resources are engaged. Although the District 
has developed a procedure by which a unit manager or project manager 
provides case-by-case justification to use a consultant for a specific project, 
the WUE does not have a tracking list of activities or work areas that it 
typically performs in-house and activities or work areas for which it typically 
relies on external resources. 


The District has also not created formal, standardized consultant performance 
tracking tools that enable project managers to document consultants’ 
achievement of scope, budget, schedule, and other areas of contract 
performance. Although this is typical for its peers, some agencies are 
beginning to implement such tools to more closely manage and document the 
performance of consultants they hire. 
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• Baldrige National Quality Program criteria, specifically, those pertaining to service 
delivery, customer focus, and performance measurement. 

• The Red Oak team’s collective experience with delivering capital projects to the public 
sector, and with similar, analogous water resources agency capital project delivery 
programs. 

Red Oak developed findings based on the fieldwork and document review described earlier in 
this memorandum. These findings are presented below according to the GAGAS findings 
structure, and are designated as either “Strengths” (positive findings with relatively minor 
recommendations for continuous improvement/optimization) or “Opportunities for 
Improvement” (findings with more significant associated recommendations for improvement). 
The District’s key audit objectives to which each finding most directly relates are also indicated. 
Please note that the findings in this audit memorandum are not presented in any particular order, 
although they are organized according to strengths and opportunities. 

Capital Program Services Strength Finding No. 1 

Key Audit Objectives: "Management of the capital program ” 


"Operational policies and procedures ” 


Criterion 

The District should have a fully documented capital project delivery 
approach and structure. This approach and structure should clearly establish 
how projects should be executed, including the roles, responsibilities, and 
measures of performance for all parties involved. This process should 
include not only individuals in CPS, but the ultimate “owner” of projects as 
well as any key support individuals or units. 

Reference: 

o Baldrige Criterion 6.1: Improving process management and value 
creation 

Condition 

CPS has a fully documented and implemented project delivery process. This 
process, CPS’s Quality Management System (QMS), is certified by the 
International Standards Organization (ISO) in its ISO 9001 group of 
standards. 

A key deliverable in the capital project delivery process is the California 
Enviromnental Quality Act (CEQA) document. However, CPS’s QMS does 
not directly include procedures and instructions to perform CEQA work. 
Instead, CPS adopts and complies with selected portions of the District’s 
Watershed Operations ISO 14001-certified system to perform CEQA work. 
These procedures include WQ 52001 (Enviromnental Management Planning) 
and WW 52001 (District CEQA Documentation Guidelines). CPS 
management reports that these procedures are well-integrated into CPS’s 
project delivery structure and currently enable closer and more formalized 
attention to environmental aspects of District projects than in past decades. 

In addition, CPS, in conjunction with Water Utility Operations and 
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® Revise and review with appropriate client representatives 
(validation meeting) 

• Finalize memorandum of findings 


Task 3.3.2 Assumptions 
Meetings: 2 total (1 validation meeting) 
Interviews: 5 individual interviews 
Deliverables: 1 preliminary draft and 1 final draft 
memorandum of findings, delivered electronically 



3.3.3 General Services 

3.3.3.1 Develop plan and schedule for background research 

3.3.3.2 Conduct background research 

• Review documents, including business planning (goals, objectives, 
approaches, action plans, etc), policies and procedures, workload 
and performance statistics, facility/equipment asset management 
program or procedures, and organizational “charter” 

• Interview Deputy Administrative Officer 

3.3.3.3 Develop audit approach 

• Identify potential audit criteria, including Carver model, Baldrige 
criteria, and internal metrics (note: Wells and Water Production 
Unit functions will be audited, if appropriate, during the Water 
Utility Enterprise audit - Task 3.4 - and not during this General 
Services audit). 

• Select critical criteria for audit 

• Establish appropriate timeframe to be audited 

• Determine how the condition will be measured for comparison to 
criteria and how conclusions will be validated with District 
representatives 

• Prepare audit instruments and detailed work plan 

• Conduct internal and client review, revise 

3.3.3.4 Conduct audit fieldwork/deskwork 

• Conduct 1 group interview 

® Evaluate equipment and facilities maintenance and warehouse 
management procedures 


APPENDIX ONE - SCOPE OF SERVICES 


Page 17 of 32 










3.5.5 Prepare memorandum of findings 

• Prepare draft for internal team review 

• Revise and review with appropriate client representatives (validation meeting) 

• Finalize memorandum of findings 


Task 3.5 Assumptions 
Meetings: 1 total (1 validation meeting) 
Interviews: 10 individual interviews 
Deliverables: l preliminaiy draft and 1 final draft 
memorandum of findings, delivered electronically 



3.6 Capital Program Services 

Key Audit Objectives: 

Assess the effectiveness and efficiency of: 

Management of the capital program 
District oversight of consultants and contractors 

Assessment oj District quality assurance procedures used to prevent or detect 
errors and omissions in preparing capital project planning and design 
specifications, contracts, and purchasing documents. 

Review of operational policies and procedures 

Compliance with State and Federal regulations 

3.6.1 Develop plan and schedule for background research 

3.6.2 Conduct background research 

9 Review District’s Capital Improvement Program/Plan (CIP) documents, 
policies and procedures for implementation of the CIP and interactions with 
other related District departments, CIP Environmental Impact Report and/or 
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Section 3 

Project Goal, Scope, and Methodology 


independent assessment of the performance and management of a program against 
objective criteria” (GAO, 2003). As discussed throughout the audit and as reflected in the 
structure of Red Oak’s audit findings appended to this report, the GAGAS performance 
auditing process consists of developing structured “findings,” each with five main 
components: 

® Criteria: the desired level of performance of a given area or function of the 
audited organization. These consist of standards, measures, expectations, and/or 
“best practices,” and should be reasonable, attainable, and relevant to the 
objectives of the performance audit. Criteria should be stated fairly, explicitly, 
and completely, and their source should be identified by the auditor. 

• Condition: the organization’s current performance or state relative to the criteria 
determined and documented during the audit, supported by sufficient, competent, 
and relevant evidence. 

• Cause: the underlying reason for the condition occurring. The cause should be 
developed by the auditor as a reasonable, convincing argument that takes into 
consideration the context of the audited organization. 

• Effect: the assessment of consequences (positive or negative) of the relationship 
between the criteria and the condition. The auditor should establish a clear, 
logical link between the condition, cause, and effect. 

• Recommendation: if applicable, an identification of a corrective action to address 
the condition so it approaches or meets the criteria. Auditors should provide 
recommendations in cases where findings can be sufficiently developed, but 
“should not perform management functions or make management decisions. 
[Doing so] impairs the [auditor’s] independence, both in fact and appearance.” In 
other words, the auditor is obliged to provide recommendations where necessary, 
but not to a level of specificity that the auditor is prescribing to the management 
of the organization exactly how to address a given condition. 

Therefore, providing the appropriate level of recommendations during a 
performance audit is typically a balancing exercise, as presented by Red Oak 
during the August 17-18, 2005 Audit Methodology Workshop held with District 
staff, and as discussed during the Audit Committee meetings throughout this 
project. 

A key component of the ultimate success of the District in gaining the full benefit of this 
audit is the District’s establishment of “Baldrige Champions.” These are individuals within 
the District who were identified by the organization - and interviewed prior to this audit 
by the Red Oak team - for their interest and capability regarding continuous improvement 
at the District and demonstrated execution and leadership skills. These Baldrige 
Champions participated in the Audit Methodology Workshop noted above, and will 
participate in an Implementation Workshop following the submittal of this report. Their 
long-term role has not yet been fully developed, but will generally be to work in concert 
with District executive management to facilitate and support the implementation of this 
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Section 3 

Project Goal, Scope, and Methodology 


Before looking externally to see how others achieve “best practices,” an organization 
wishing to apply benchmarking should understand its own process as a baseline for 
comparison. The power of process benchmarking is its ability to quickly identify potential 
improvements to a process or system—unlike metric benchmarking, which focuses on 
numerical outcomes and typically does not identify appropriate process improvements. 
Process benchmarking is where most private-industry benchmarking activities have 
focused and also generally provides the public sector with the best return on its 
benchmarking investment. While it may incorporate selected elements of metric 
benchmarking, process benchmarking is focused more on making key business processes 
both more effective and more efficient. 

It is for the reasons above, combined with the wide-ranging (District-wide) scope of this 
audit and the District’s existing strong focus on Baldrige-based performance management, 
that Red Oak selected process benchmarking for this performance audit. 
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9. Baldrige Category 3 - Customer and Market 

Focus 


The Baldrige program defines “customer and market focus” as "How [an] organization 
determines the requirements, expectations, and preferences or customers and markets,” 
and “ how [it] builds relationships with customers and determines the key factors that lead 
to customer acquisition, loyalty and retention, and to business expansion and 
sustainability. ” 

The discussion below is reflective of individual audit findings presented in all the audit 
memoranda appended to this report. 


9.1. Communications Strategy 


The District engages in a high degree of externally oriented activity at all levels of the 
organization, and Red Oak found auditees throughout the organization to be highly aware 
of the District’s customers and stakeholders. However, throughout the performance audit, 
Red Oak found patterns similar to those of the District’s strategic planning efforts in the 
area of customer relations. Specifically, the main departments of the District have 
historically been strong in the areas of customer outreach and public relations; however, 
until now, this has been performed in the absence of agency-wide cohesion in the form of 
a District-wide vision/mission specific to external communication and internal service 
expectations. This is evidenced by the different independent internal and external customer 
outreach efforts in place at the District. 

While the District is to be commended for having a well-developed Office of 
Communications staffed with experienced professionals, this office currently has no clear 
vision or mission statement and is unclear on the Board/CEO’s direction as to whether the 
Office should be highly active in terms of public information and making the District a 
high-visibility agency, or strive to maintain a lower public profile. Additionally, the 
District has not utilized this office to its full potential for identification and relationship¬ 
building efforts with key customer groups. Furthermore, the Office of Communications is 
not used by all District departments/units for significant external communications from 
the District to its stakeholders. In fact, the District has developed separate, department- 
dedicated communications functions within its operating groups (e.g., the Water Utility 
Enterprise). Similarly, the District has also developed human resources and other 
capabilities in its operating groups, in many cases to take the place of functions originally 
intended to be centralized within Administration instead of to complement 
Administration’s efforts. The “corporate” Office of Communications and the 
communications functions in the operating groups are not closely coordinated, which has 
led to different District customer lists and definitions, as well as losses in efficiency in 
executing communications-related tasks. Parallel functions can also lead to parallel, 
confusing, or conflicting messages being delivered to interested parties. 
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Key Themes: Three Years of Assessments 


RED OAK 2006 

Strengths 

Areas for Improvement 

The District is very strong in individual 
professional disciplines throughout the 
organization. 

The District lacks the well-developed, 
organization-wide cohesion in planning and 
execution that would set it apart from its peers 
and that is a trademark of top-performing public 
and private-sector organizations. 

The District is very strong in department or 
business-level strategic business planning. 

The District lacks a true agency-wide strategic 
business plan. 

The District is pursuing continuous 
improvement and striving for excellence, 
including adopting a policy governance 
model; pursuing ISO registration throughout 
the organization; and developing 
agency-wide performance measurement 
aligned with the Baldrige program. 

Certain fundamentals need focus, including: 

• Health and Safety 

• Floodplain management definition 

• Implementation of a complete Enterprise 
Resource Planning system 


CAP 

E 2006 

Strengths 

Areas for Improvement 

Application of the Baldriae Criteria 

Partner, Supplier Relationship 

The District has used the criteria as ci driver for 
improvement, and the structure of the criteria 
to drive integration. 

Partners and suppliers are not directly included 
in many of SCVWD's approaches. They have 
not been involved in strategy development, 
information sharing, and process design. The 
mission and vision have not been deployed to 
partners and suppliers. 

Policy Governance Model 

Understandina Who the Customers Are 

The model provides an approach that is well- 
documented and allows for an understanding 
that reaches deeply into the organization. It 
also focuses the Board on clearly 
communicating the citizens' expectations, 
which are dearly communicated in policies. 

This approach allows SCVWD to be managed 
by its management rather than micro- 
managed by the Board. 

There is confusion between the roles of end- 
users and retailers. Most customer satisfaction 
determinations are not direct measurements, but 
rather internal process measurements. 

Open Communications: Transparency of 
Governance 

The Carver governance model and Baldrige 
foundation result in a style that actively seeks 
dialogue and governance and that is 
transparent to employees, the Board and 
citizens. In this culture and style openness is 
second nature. 

Manaaement of Action Plans, Initiatives 

There is a need to link planning to objectives 
and deploy initiative management process. 
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managers to use it effectively. 


Finding No. 2 - Strength 
Key audit objective: N/A 


Criterion 

The District’s Administration organization should make a regular 
effort to understand internal customer needs, as well as their own 
strengths and opportunities for improvement, through outreach to 
customers in the form of surveys, questionnaires, and/or other forms 
of fomial feedback. Furthermore, Administration should make 
efforts to incorporate customer feedback into their operations to 
ultimately improve their District-wide services. 


References: 

• Baldrige - 6.2: Support Processes and Operational Planning 

Condition 

Of the 18 Administration units in the General Services, Human 
Resources, Clerk of the Board, and Administrative Services 
Divisions, at least 11 of them have regular written customer 
feedback mechanisms in place, but they vary in extent and 
application. In addition, at least two of the units without this 
infrastructure consider customer outreach a major goal for their 
units, or otherwise actively solicit feedback from their customers 
(e.g., the “Account Manager” concept implemented in the 
Information Management Division as described elsewhere in this 
memorandum). 


One clear example of incorporating customer feedback comes from 
the Office of the Clerk of the Board. That office distributes an 
annual survey to over 100 District staff and all 7 Board Members. 
Although usually just over half of the surveys distributed are 
completed and returned, the Office of the Clerk of the Board 
improved the on-line agenda process as part of the COB work plan 
in response to customer suggestions. Examples of other feedback 
mechanisms provided for Red Oak’s review include the District’s 
are annual “Treatment of Staff’ survey and the Human Resources 
Benefits Administration Unit Customer Satisfaction Survey. 

Cause 

The Administration organization at the District generally 
understands its role as the key central service provider to the 
District’s operating units, and has established formal mechanisms to 
optimize its services based on feedback from its internal customers. 

Effect 

Based upon the information available to Red Oak, Administration 
has multiple vehicles in place to maintain and improve the services 
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as a technical consultant and in the organization of a vulnerability study 
for District infrastructure. 

In addition, the RMA signs off on most Board items to verify that the 
items have been reviewed for risk implications and insurance protection 
as appropriate. The RMA is also called in to discuss risks and their 
treatments with the technical advisory committee that makes up bid 
specifications for new capital projects. The RMA also reports that he 
relies on informal communication channels in addition to formal means 
to ensure that he is abreast of the District’s wide range of activities and, 
therefore, potential risks. 

Cause 

The RMA has worked continuously to be included in all major 
information flows within the District, both formal and informal, to 
assure that the appropriate review of the District’s activities and plans 
from a risk management perspective takes place. 

Effect 

Because of the multiple approaches described above, the risk 
management unit is able to maintain a high level of awareness of 
District activities and related risks, thereby enabling control of and 
techniques for financing (insurance and funded self-insurance) District 
risks as appropriate. (Although one of the RMA’s current methods of 
ensuring he is abreast of all activities at the District that may need risk 
management services is informal communication, and this is effective, it 
highlights the need for perhaps more formalized integration of support 
services across Administration into the operating/capital project 
planning process at the District.) 


Finding No. 14 - Opportunity 

Key audit objectives: “Risk management/insurance costs 


Criterion 


Estimated ultimate liabilities for a given policy year should be funded 
to a reasonable level of confidence. Minimum confidence levels for 
self-insured public entities is not specifically regulated in California, 
but a range of commonly accepted funding confidence levels is 55% to 
90%. Those organizations funding to lower confidence levels usually 
do not discount. An appropriate level of flexibility should be built in to 
allow the District to take advantage of fluctuations in market 
conditions. 

References: 

• Board Policy EL-7 (7.2): Asset Protection 

• GASB Statement No. 10 

• Baldrige 1.2: Governance and Social Responsibility _ 
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Effect Many District staff believe that the PeopleSoft implementation has taken too 


long and, in some cases, are not satisfied with the quality of the implemented 
product. For example, the District’s ERP package was procured without a 
budget module, which was a conscious decision by the District because the 
available module would not support the District’s eventual goal of 
performance-based budgeting without an undesirably high degree of 
customization. The District’s Budget Office has been able to expand upon a 
project management tool developed in Capital Program Services and deploy 
it District-wide for budgeting purposes. These steps have necessarily taken 
times has necessarily taken time, and the ownership and maintenance 
responsibilities of this function are still being formalized and fully 
communicated. 

Staff also consistently indicated that the relatively slow pace of the ISMP 
implementation was problematic; for example, the WRIS replacement has 
only recently begun. The District is not realizing the potential work process 
improvements because of this delay. 

Recommendation The District should revisit the ISMP and update it based on current 
conditions. Using “lessons learned” from the PeopleSoft implementation and 
other ISMP projects, the District should develop a pragmatic view of its IT 
projects over the next three years and determine budgets, schedules, and 
dedicated staff requirements. This update of the ISMP should involve more 
detail than currently exists and should take into consideration the 
interdependencies on other IMD and District-wide projects/initiatives. 
Dedicated staff should be identified and reserved through the use of BPAs as 
discussed in an earlier finding in this memorandum. The broader 
recommendations made elsewhere in this memorandum regarding planning 
and prioritization District-wide will also yield benefits with respect to ISMP 
management and implementation. The District appears to be on an 
appropriate course with respect to its development and full, consistent 
implementation of its District-wide budgeting tool. 


Finding No. 29 - Opportunity 

Key audit objective: “Information management ” 

Criterion The District should treat major IT initiatives “like projects,” i.e., with formal 

planning and management, and attention to schedule, budget, resources, and 
risk management. Project management data should be readily accessible on 
each IT project, and planned vs. actual performance should be routinely 
reported and reviewed. 
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Finding 34- Opportunity 

Key audit objectives: “Management of real property owned by the District and physical assets - 
facilities and infrastructure ” 


Criterion 

The District should have a system in place to routinely to make timely, 
informed, and cost-effective decisions regarding the disposition of its 
real estate properties. 


B Board Policy EL- 7 (Asset Protection) 

B Baldrige 3.2: Customer Relationships and Satisfaction 
■ Baldrige 4.2: Information and Knowledge Management 

Condition 

The District currently does not have a formalized policy or decision¬ 
making tool to allow it to make timely, efficient, and consistent 
decisions regarding the disposition of properties it acquired in the past 
but no longer needs (an “Excess Lands” program per District real estate 
staff). As a result, when such decisions are necessaiy, District staff 
often have a variety of opinions, but there is no clear decision-maker. 
As a result, such matters often are brought to the Board of Directors, 
where additional opinions are gathered and additional time is spent. 
Neither the Board nor District staff have a set of agreed-upon, codified 
criteria that the District’s real estate professionals or executive 
management can use to decide whether to retain, sell, or otherwise 
dispose of property no longer of use to the District. 


Red Oak understands that a certain number of properties may have 
high-profile issues that require the attention of the CEO or the Board 
regarding their ultimate disposition. However, in most cases, having a 
decision-making tool as described above would streamline and clarify 
the process, as well as free up the Board consistent with their adopted 
policy governance model. 

Cause 

The District has not placed a priority on formalizing its policies for the 
disposition of its real estate, especially unused or underutilized 
properties. 

Effect 

The lack of a formalized policy or set of decision criteria regarding the 
disposition of unused properties makes it difficult and inefficient for the 
District to make property management decisions (e.g., whether to lease, 
sell, or otherwise manage or dispose of, an unused piece of District 
property). It also restricts the ability of the District’s real estate and 
other professionals to respond to the varying views of internal and 
external stakeholders (e.g., neighboring property manager s/owners), 
regarding the District’s decisions on property of interest to them. This 
condition can result in excessive staff (and Board) time spent on 
decisions that could be made more efficiently. 
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10. General Services Findings 



Finding No. 36 - Opportunity 


Key audit objective: 

N/A 

Criterion 

The District’s procurement process should be sufficiently responsive 
and streamlined to effectively support the business needs of its 
internal customers. 


References: 

• Baldrige — 6.1: Value Creation Processes 

• Baldrige - 6.2: Support Processes and Operational Planning 

Condition 

Unit manager auditees within Administration consistently report 
difficulty in receiving timely and accurate service from the District’s 
internal procurement function. For example, they report receiving 
exactly the piece of inventory they requested not be ordered, and 
express frustration with the length of the process as well. The 
District is typical in this regard; that is, the purchasing/procurement 
function of similar agencies is often perceived as problematic and 
insufficiently responsive by its internal customers. This condition 
may be directly related to the finding earlier in this memorandum 
regarding Administration unit managers reporting difficulty in 
knowing their priorities. The unit manager for Procurement reported 
that in the recent budget year, for example, an unplanned “initiative” 
diverted 3000 hours worth of his unit’s staff time that was scheduled 
to be spent on core procurement activities. Red Oak was not able to 
verify this with documents made available for this audit. 


Red Oak understands that the District recognizes this situation and is 
underway with improvements. Specifically, the District is working 
on the implementation of “e-procurement” to streamline the existing 
process, produce better data for performance measurement, and 
enable better responsiveness to customer requests. 

Cause 

The procurement function may be affected by the general lack of 
prioritization at the District. In addition, the District has not until 
recently placed a priority in responding to customer feedback and/or 
self-improvement in the area of its internal procurement services as 
it has done in other areas as noted in this memorandum. 

Effect 

Due to frustration with the existing process and results, District staff 
use other methods to obtain equipment or supplies. This creates an 
inefficiency, as a centralized service function is not utilized and staff 


Page 62 of 66 


October 11, 2006 












from the unit requesting the materials are diverted from their core 
activities. Projects can also be delayed due to delivery of erroneous 
items or lack of responsiveness. 

Recommendation 

The District should place a priority on both troubleshooting and 
streamlining its procurement functions, as is already underway. The 
District may also want to include work-process mapping to 
understand where communication breakdowns occur and determine 
points of accountability. The District should also ensure that the 
Procurement Unit’s internal customers are aware of the policies and 
procedures involved in the procurement process. 

Note: Based on audit activities, Red Oak also understands that 
Administration’s General Services Division is also responsible for a 
number of facility and asset management activities, including 
vehicle fleet management and facility management, complementing 
the Real Estate Division’s property management activities noted 
earlier in this memorandum. 


11. Board of Directors Finding 

(Note: though this finding is largely related to the Board of Directors, it was not included in the 
Board audit memorandum since insufficient information was available at the time. It is included 
in this memorandum because it was a component of the Audit Committee meeting addressing 
Administration and Financial Services.) 

Finding No. 37 - Opportunity 

Key audit objective: ‘‘Effectiveness and efficiency of the Board of Directors ’ oversight of the 
District” (Board of Directors key audit objective) 


Criterion 

The District should manage the Board Member Request process so 
that an appropriate balance is struck between providing necessary 
information to Board members and incurring an undue amount of 
staff diversion and cost. 


References: 


• Board Policy EL-9: Communication and Support to the 


Board 


• Baldrige -1.2: Governance and Social Responsibilities 
a Baldrige - 4.1: Measurement, Analysis, and Review of 


Organizational Performance 
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Cause 


Effect 


Recommendation 



systematically track, account for, and report on, all grants or cost-sharing 
activities that may take place throughout the District. 

Much grant and cost-sharing information is made available to the Claims 
Reimbursement Unit, but based on input from staff and Red Oak’s inquiries 
regarding grant and cost-sharing activities throughout the District’s 
operational groups, a number of grants or cost-sharing partnerships proceed 
untracked on a centralized basis. The documentation associated with these 
grants and cost-sharing arrangements is similarly fragmented - some is 
maintained in the District’s Treasury and Claims Reimbursement Unit while 
some is not. 

There is no centralized District-wide grant and cost-sharing management 
function in place. The District does have a position dedicated to claims 
reimbursement; however, this function is not systematically included in the 
development, application, tracking, processing, and reporting of all cost¬ 
sharing and grant activities across the District. The District’s current need for 
this function crosses organizational boundaries; that is, the process/system 
needs to be available for use by both project managers who control how 
funds are spent, and the financial services staff responsible for securing and 
processing reimbursement. 

The District is not able to readily demonstrate to internal and external 
stakeholders the extent to which it participates in grants and cost-sharing 
efforts across the organization. In other words, the tracking and 
documentation of the District’s grant and cost-sharing efforts is somewhat 
fragmented and incomplete. This could result in grant applications being 
filed without consideration of the budget implications of matching fund 
requirements. In addition, incomplete or missing documentation could result 
in the rejection of reimbursement claims by grantor agencies or challenges 
by cost-sharing partners. 

The District should formalize, document, and orient necessary staff to the 
grant application and cost-sharing program process. Red Oak acknowledges 
that the District engages in a wide variety of grants and cost-sharing 
opportunities, with respect to other agencies involved, funding/cost-sharing 
levels, technical areas, application requirements, and timeframes. 
Nevertheless, a best organizational management practice is to centrally 
manage and track organization-wide involvement in key external affairs such 
as grants and cost-sharing arrangements. 

This process should involve tracking each grant and cost-sharing opportunity 
from the beginning stages through the expenditure of funds, and ensure 
complete and appropriate levels of reimbursement. This process should also 
enable District staff to readily report to management, Board members, and 
interested external parties the District’s involvement in such efforts across 
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execute their missions. The approach and its concomitant policy and 
authority structure were adopted, with modifications, by the District after 
careful consideration and after review by District legal counsel. 

Red Oak has confirmed through this audit work that there is a clear and 
continuing connection between actions of the Board and established policies 
and responsibilities, and Red Oak believes that, in general, the District has 
achieved a sound balance between the responsibility of the Board and the 
executive authority of the CEO. 

Effect 

The District has consistently produced budgets that meet best practices as 
defined by the GFOA, as indicated by its receipt of the Distinguished Budget 
Presentation Award for a number of years 

With regard to the recent SCC/MAD report, it appears that, in the past, only 
cursory attention was given to the District budget by the Board of 
Supervisors. Information provided has always been at a very high level, 
without significant detail. The SCC/MAD review applied a much more 
rigorous approach, which was unexpected by either party. 

Cause 

District staff, encouraged by management and the Board, has consciously 
sought to develop budgets in accordance with best practices. 

The SCC budget process continued as it had in the past; there was no 
indication until the SCC/MAD report that any other procedure was desired 
by the County. 

Recommendation 

The current policies and procedures and then documentation are well 
developed and executed. The approach and documentation should be 
expanded as necessary as the role of the Financial Services Division evolves 
with respect to performance measurement. 

Red Oak’s research indicates that the SCC budget review requirement is an 
artifact of political circumstances that existed at the time the District was 
established. Because that happened quite some time ago, it would be 
reasonable to re-examine the efficacy of this process, particularly given the 
fact that it is not a common requirement for water districts in California. Red 
Oak recommended at the time of this financial audit that the respective 
elected officials of each entity create a forum for the discussion of this 
fundamental issue and determine whether to initiate legislation to rescind the 
requirement that the County review and approve the District budget. Red 
Oak noted at the time that if this requirement were not rescinded, Red Oak 
agreed with SCC/MAD that it is imperative that a clear, precise definition of 
the level of review and the responsibilities of all parties be developed, 
documented, and agreed to by both entities. 

Since the time of Red Oak’s audit fieldwork in this area, legislation was 
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The link between financial management and performance management 
should be strengthened. This link could be provided by a transition to 
perfonnance budgeting, which ties costs to specific performance goals. This 
would integrate perfonnance measurement/management with the District’s 
core business process. This transition should be the joint responsibility of 
Financial Services and the Office of Performance Management. 

Red Oak understands that since the time of this audit fieldwork, the District 
has moved forward with elevation of the financial function in the 
organization, along with creating a closer organizational link between 
financial and performance management, which directly addresses a number 
of Red Oak’s recommendations in this and related audit findings. 


FINDING 2.1(a) 


Criterion 

GAO Practice 2: Provide Clear, Strong Financial Leadership 

GAO Practice 2, Key Point 1. The chief executive recognizes the 
important role the finance organization can play in improving overall 
business perfoimance and involves key business/line managers in 
financial management improvement initiatives. , 

GAO Practice 2, Key Point 2. The CFO is a member of the top 
management team. 

GAO Practice 2, Key Point 3. Top executives’ sustained commitment to 
improving financial management is reinforced through both their words 
and actions. 

The District should exhibit these GAO Practice characteristics. 

Condition 

The top-ranked financial executive in the District reports to the CEO through 
the Director of Administration. In general, Red Oak observed that the 
orientation of the top financial executive is “down” into financial operations, 
rather than “up” to the CEO and Board. The District’s finance function does 
not have a clearly articulated vision or strategic plan. 

The focus of the District on the implementation and improvement of 
performance measurement and management using the Baldrige criteria, 
while important and in many ways effective, has contributed to the financial 
management function playing a peripheral role in policy and strategy 
development. 

Effect 

Financial management in the District, while providing a firm foundation of 
accountability and fiduciary responsibility, does not emphasize service in 
support of operating objectives. It is also not well integrated into the 
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with suitable amounts of detail and explanation. 


FINDING 9.0(a) 

--Fee and Rate-setting 

Criterion 

Fees and rates should be set to adequately fund the operations they support 
consistent with appropriate economic relationships. Specifically, in 
accordance with standards established by the American Water Works 
Association (AWWA), water rates should be set at a level to fully fund all 
legitimate costs of water production and delivery in accordance with the 
customer’s responsibility for those costs. 

Best practices in the water utility industry reflect annual rate-setting 
exercises that are clearly communicated to decision-makers and customers. 
In addition, in accordance with GFOA-recommended practices, long-term 
financial implications should be considered in rate-setting. 

Condition 

The only substantial fee and rate-setting process is conducted by the business 
group in the Water Utility Enterprise for water rates. Other fees are generally 
set by law or based on a budget allocation from the State level and do not 
require fee or rate determination by the District. 

This process is appropriately placed, since water utility rate-setting is a 
highly specialized area of expertise and is an essential component of utility 
management. Outplacement of the function promotes a high level of 
consistency between financial management and operating objectives in this 
area. Review of internal financial management plans and rate reports 
demonstrates a high level of competence in this area. Financial forecasts are 
prepared and various scenarios are evaluated that give decision-makers a 
clear understanding of the probable consequences of current decisions. 

Effect 

The District’s water rates are defensible and adequate from a revenue 
sufficiency standpoint. 

Cause 

Establishment of a business unit within the Water Utility Enterprise has 
facilitated this level of achievement. 

Recommendation 

While this area is competently managed by the District, rate-setting is a 
naturally adversarial process as retailers feel the pressure of increasing costs. 
Consideration should be given to periodic rate studies and/or reviews of 
internal rate studies by a qualified outside consultant. This approach will 
enhance accountability and credibility for the District’s rate-setting process 
in the long term. 


Page 28 of 32 


October 11, 2006 








policies, procedures, and practices for financial, administrative, and operational management, 
and capital planning and management. 

The key audit objectives for the Watershed Operations audit provided to Red Oak by the District 
were as follows, as indicated in Task 3.5 of the scope of work; 


“Assess the effectiveness and efficiency of: 

• Operational policies and procedures 

® Compliance with State and Federal regulations 

• Assessment of existing practices and comparison with best practices and 
relevant benchmarks: 

• Cost effectiveness 

• Overhead 

• Environmental management” 


The fieldwork for the Watershed Operations audit consisted of the following components: 

® Document reviews 

• Interviews with the following key staff: 

o Chief Operating Officer (COO) 

o Deputy Operating Officers (DOO) of the Lower Peninsula/West Valley and 
Guadalupe Watershed Division and the Coyote and Uvas/Llagas Watershed 
Division 

o Assistant Operating Officer (AOO) of the Office of Watershed Planning 
o Unit Managers of the following units: 

■ Lower Peninsula/West Valley, Coyote and Uvas/Llagas, and Guadalupe 
Watershed Field Operations Units (3) 

■ Lower Peninsula/West Valley, Coyote and Uvas/Llagas, and Guadalupe 
Watershed Engineering Units (3) 

* Ecological Services Unit 

■ Vegetation Management Unit 

■ Regulatory Compliance Unit 

■ Stream Water Quality Unit 

■ Community Project Review Unit 

* Watershed Business Management Unit 

• Questionnaires completed by the above individuals 

Following the fieldwork and preparation of preliminary versions of the findings presented in this 
memorandum, Red Oak (1) validated the preliminary findings with the staff listed above, (2) 
presented the findings and recommendations to the Audit Committee on July 25, 2006, and (3) 
validated the draft version of this memorandum with the COO. This final memorandum 
incorporates input provided to Red Oak during all these steps. 
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and capital planning and management. 


The key audit objectives for the WUE audit provided to Red Oak by the District were as follows, 
as indicated in Task 3.4 of the scope of work: 


“Assess the effectiveness and efficiency of: 

® Operational policies and procedures 

® Compliance with state and federal regulations 

• Assessment of existing practices and comparison with best practices and relevant benchmarks: 
o Cost 
o Overhead 
o Asset management 
o Reliability of service 
o Environmental management” 


The fieldwork for the WUE audit consisted of the following components: • 

• Document reviews 

• Interviews with the following key staff: 

o Chief Operating Officer (COO) 

o Deputy Operating Officers (DOO) and Assistant Operating Officers (AOO) of the 
Water Supply Management Division and Water Utility Operations Division 
o Unit Managers of the following units, selected due to their high degree of 
relevance to the audit objectives indicated above: 

■ Imported Water Unit 

■ Water Supply Sustainability Planning Unit 

■ Water Use Efficiency Unit 

■ Operations Planning and Analysis Unit 

■ Utility Maintenance Unit 

■ Infrastructure Planning Unit 

■ Water Utility Business Management Unit „ 

o Asset Management Program Leader f 

o Senior Project Manager in COO’s office 

• Questionnaires completed by the above individuals and other unit managers in the WUE , 

Following the fieldwork and preparation of preliminary versions of the findings presented in this 
memorandum, Red Oak (1) validated the preliminary findings with the staff listed above, (2) 
presented the findings and recommendations to the Audit Committee on My 25, 2006, and (3) 
validated the draft version of this memorandum with the COO. This final memorandum 
incorporates input provided to Red Oak during all these steps. , 

■ 

Per the scope of work, the Comprehensive Performance Audit was an objective and independent 
evaluation of the Board of Directors’ (Board) compliance with their Governance Policies, and 
the Chief Executive Officer’s implementation of the Board’s Ends and Executive Limitation 
Policies. To that end, the audit scope was broad (District-wide), but necessarily limited to the 
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The District’s water retailers generally rate the District’s water quality and 
regulatory compliance performance highly, as evidenced by multiple years of 
annual retailer survey results, and Red Oak’s external stakeholder interviews 
conducted earlier in the audit. 

In addition to treating water, the WUE plans and executes local surface water 
operations for which it needs to comply with requirements to maintain 
channel flows for fish habitat maintenance. In former times, the District 
operated its local water systems for water supply purposes only, e.g., to not 
“waste” any channel flows past in-stream recharge locations within the Santa 
Clara sub-basin. It now operates these same facilities for environmental 
stewardship purposes in addition to water supply purposes. This is evidenced 
by verbal information provided by multiple auditees, as well as the 
operational parameters to which the District has agreed as indicated in the 
Fisheries and Aquatic Habitat Collaborative Effort (FAHCE) report, and as 
indicated by the inclusion of low-point alarms in the District’s channels as 
indicated in the FY 2006 WUE Business Plan and the most recent 
Hydrologic Data Management Report to ensure adequate flows for fish 
habitat maintenance. This practice was instituted by the District as part of the 
FAHCE, and is an example of a process improvement for ongoing regulatory 
compliance, as well as fulfillment of one aspect of the District’s goal of 
“comprehensive water management” in Santa Clara County for multiple 
puiposes. 

As indicated in Red Oak’s audit memorandum on the District’s 
Administration organization, regulatory compliance with respect to Health 
and Safety (H&S) is a clear opportunity for improvement throughout the 
District. As evidenced by verbal information from multiple WUE auditees, 
Red Oak’s findings from the Administration audit, and several WUE staff 
member’s involvement in H&S program development and implementation 
within the WUE as documented in the FY 2006 WUE Business Plan, the 
District’s centralized H&S function has not been able to deliver adequate 
H&S compliance services to the WUE. 

The WUE is to be commended for making H&S compliance a top priority in 
the absence of an effective program being delivered from a central location 
within the District; however, this may not be a sustainable solution as 
discussed in the Administration memorandum. Specifically, H&S functions 
currently reside in multiple organizational units within Administration and 
the District’s operating and capital groups, and it is unclear what the 
District’s model is for the provision of H&S services going forward. The 
District has formed one or more H&S committees made up of WUE and/or 
other operating group personnel to fill the H&S gap in Administration. The 
WUE also plans to hire its own H&S program leader (as does Watershed 
Operations). These actions may provide short-term remedies to address the 
District’s immediate H&S needs, but collectively are likely neither an 
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650 MWh (again, assumed annual). 

Imported Water Contracting 

The single largest cost area by far for the WUE as indicated by documents 
provided to Red Oak is imported water purchases. A review of the District’s 
Board’s Governance Policies and WUE procedures indicates that imported 
water agreements must be processed through the District’s Contracts 
Administration System, which is set up primarily for standard professional 
service, vendor, and construction contractor agreements, and not necessarily 
for wholesale water purchases. This may not pose a problem for the major, 
long-term wholesale water agreements into which the District enters (i.e., its 
master contracts for State Water Project and Central Valley Project water), 
but is likely cumbersome for more time-sensitive water agreements such as 
water transfer agreements. Nimbleness and the ability to arrive at decisions 
quickly are increasingly important in this area, because the number of 
“transferors” in the water transfer market is relatively small and the market 
can be very competitive and fast-moving. 

From a legal perspective, the negotiation of a water supply contract or water 
transfer with any party is clearly a “sole-source” transaction, and qualifies 
under the Brown Act for discussion in closed session with the Board when 
necessary, because it deals with a form of interest in real property. Closed 
sessions can allow the District’s negotiators to get instructions from the 
Board on a confidential basis. 

Although the District has developed a method to expedite imported water 
agreements through its existing procurement process, it may want to 
investigate customizing the process for executing wholesale water 
agreements without compromising the level of approval necessary. This may 
represent an area for significant potential cost savings, and the District may 
wish to prioritize the development of associated cost metrics. 

Specifically, Red Oak encourages the District to consider exempting 
negotiation and processing of these unique agreements from its standard 
procurement and contract administration process and set up a separate 
mechanism for handling them. The revised process should include the 
District’s key decision-makers with respect to wholesale water agreements, 
provide for early authorization of the negotiating parameters to be used by 
the negotiation team (including via closed session if necessary), and give the 
District’s negotiators expedited direct access to the decision maker(s) when 
needed. Although setting up different types of contract processing 
procedures is not advised for most types of transactions, it appears 
appropriate due to the time-sensitivity and magnitude of the District’s 
wholesale water agreements in comparison to its overall Water Utility 
Enterprise budget. _ 
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Effect 

CPS managers and staff understand how their projects and decisions support 
the organization's overall vision. 

Recommendation 

CPS should maintain its focus on achieving the District’s goals and 
implementing its vision. In addition, the District/CPS should investigate the 
benefits of executing projects in conformance with the United States Green 
Building Council Leadership in Energy & Environmental Design (LEED) 
program. This is something that similar agencies with a “greener” or 
environmentally responsible vision/mission are currently doing. 

Capital Program Services Opportunity Finding No. 1 

Key Audit Objectives: “Management of the capital program ” 

“Opera tional policies and procedures ” 

“Compliance with State and Federal regulations ” 

Criterion 

The District and, therefore, the CPS, should have a systematic process in 
place to determine whether an “alternative delivery” approach (e.g., Design- 
Build, Design-Build-Operate, Construction Management [CM] at Risk, self- 
performed construction, and other strategies) or the traditional Design-Bid- 
Build model would be most appropriate for increased quality and/or reduced 
cost for each project. 

References: 

o Baldrige Criterion 6.1; 6.2 (6.2.a.3): Process management, support 
processes, operational planning (e.g., “processes meeting 
requirements and cost control”) 

Condition 

At present, the District lacks a systematic approach for considering and 
executing alternative delivery, although the District has considered at least 
one type of alternative project delivery approach (Design-Build), as indicated 
by an internal position paper provided to Red Oak. Santa Clara County was 
among the first counties in the State of California to receive authority to 
execute public projects on a Design-Build basis. In 2001, the District 
supported legislation that allowed it to take advantage of this method. In 
2005, the District supported legislation that extended the sunset of the 2001 
legislation until 2011 and lowered the project-size eligibility from $20M to 
$2.5M, However, these developments are not universally known among CPS 
staff, and the District has not updated its QMS procedures on capital project 
delivery approaches to take advantage of the change in legislation described 
above. 

Cause 

Although alternative delivery has been considered at the District, and 
favorable legislation has been implemented as described above, CPS 
management reports that the District has not moved forward on alternative 
delivery implementation because of three perceived conflicts with the 
District Board’s Ends Policies and Executive Limitations as follows. 
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No. Title _ 

314 Organizational ChallengeSj 2005-2009 

315 Organizational Charts 


316 Overview - Classification of Positions, Administrative Policies and Procedures 

317 Overview, of LEED program 

318 Overviews of Water Utility Business Process Categories for AWWA Peer Review Team 

319 Payroll Hotline Responses Metric Worksheet 

320 PeopleSoft SOPs 

321 Performance Indicators for Water and Wastewater Utilities Part 1 

322 Performance Indicators for Water and Wastewater Utilities Part 2 

323 Performance Indicators for Water and Wastewater Utilities Part 3 

324 Performance Indicators for Water and Wastewater Utilities Part 4 

325 Performance Measures presentation 

326 Performance Measures Reporting System (PMRS) printout: invoices 

327 Performance Measures Reporting System (PMRS) printouts: Watershed Operations as of 3rd Quarter FY 
2006 

328 Pipeline Maintenance Workload Analysis 

329 Planning Phase WBS Descriptions and Instructions (W73002, Revision E) 

330 Policies and Procedures (Admin. Policy/Procedure-2.5) 

331 Preparation for Board Work Study Session - Questionnaire 

332 Process Flpw Chart for Determining Level of Involvement in Identified Issues/Projects 

333 Procurement and Inventory Management FY 06 Adopted Detail Budget 

334 Procurement and Inventory Management Organizational Chart 

335 Procurement and Inventory Management Unit Description 

336 Procurement and Property Management (Admin. Policy/Procedure-5), Warehouse Services (Admin. 
Policy/Procedure-5.2) procedure 

337 “Proforma" Q2 2006 budget spreadsheet 

338 Project Initiation (Q72101, Revision E) 

339 Project Report - CPSD Engineering Competency Model (Draft) 

340 Proposed CEO Work Plan 

341 Quality Enhanced Management System Document No. WQ84001, Revision R3, Regulatory Compliance 
Procedure 

342 QualServe Report of Peer Review, prepared for Santa Clara Valley Water District 

343 QualServe Self-Assessment Report 

344 Quarterly Report of Investments as of December 30,2005 memorandum 

345 Raw Water SOPs 

346 Real Estate Mission Statement} Code of Ethics Resolution 

347 Real Estate SOPs (4) with status tracking table 

348 Real Estate Unit Budget FY 06 

349 Real Estate Unit Description 

350 Real Estate Unit Organizational Chart 

351 Receptionist/Word Processing - Business Plan 

352 Receptionist/Word Processing - SOPs 

353 Recommended Practices (published and updated series) 

354 Records and Library - 05/06 Budget 

355 Records and Library - Metric Definition Worksheet 

356 Records and Library - Overview 

357 Records and Library - Policies and Procedures 

358 Records and Library - SOPs 

359 Recruitment and Examination Annual Business Plan: FY 2005 

360 Recruitment SOPs 

361 Regulatory Compliance Program, Watershed Permit Management System (WPMS) Requirements 
Document 

362 Report on Compliance and Internal Control over Compliance Applicable to each Major Federal Award 
Program 

363 Report on Real Estate Activities Approved Under EL-5.8 (2nd Quarter FY 2004) memorandum 

364 Request for Interest-based Facilitation 

365 Resolution 05-31 Approving and Adopting Santa Clara Valley Water District Budget for FY05-06 

366 Review of the FY 2005-06 Santa Clara Valley Water District Operating and Capital Budget 


367 Right of Way Acquisition memorandum 

368 Salary Benchmark Survey (rough data only) 


Bibliography 


Author/Source _ Date _ Type of Document 


SCVWD - Watershed Operations 

December 17, 2004 

Hard copy 

SCVWD 

January 2004; November 2004; 
April 2005; August 2005; January 
2006; April 2006 

Hard copy 

SCVWD - Human Resources Division 

January 2004 

Hard copy 

United States Green Building Council Leadership in Energy 
and Environmental Design 

Accessed August 8, 2006 

Green Building Council website: 
http:// wwvv. usgbc.org/ 

SCVWD 

October 1998 

Hard copy 

SCVWD - Financial Services Division 

Received September 30,2005 

PDF document 

SCVWD - Human Resources Division 

Various 

MS Word and Excel files 

A. Lafferty & W. Lauer for the American Water Works 
Association (AWWA ) 

2005 

Book 

A. Lafferty 8c W. Lauer for AWWA 

2005 

Book 

A. Lafferty 8c W. Lauer for AWWA 

2005 

Book 

A. Lafferty 8c W. Lauer for AWWA 

2005 

Book 

SCVWD - Ecological Services Unit 

Undated 

Hard copy 

SCVWD - Financial Services Division 

Received September 30, 2005 

PDF document 

SCVWD - Watershed Operations 

Undated 

PDF document 

SCVWD - Water Utility Operations Division 

November 22,2005 

MS Excel spreadsheet 

SCVWD 

May 6, 2005 

Hard copy 

SCVWD - Human Resources Division 

Received November 10, 2005 

PDF document 

SCVWD 

July 27,2004 

Hard copy 

SCVWD 

Undated 

Hard copy 

SCVWD 

Undated 

MS Word document 

SCVWD 

August 2005 

HTML file 

SCVWD 

Undated 

PDF document 

SCVWD 

February 2005 

PDF document 

SCVWD - Water Utility Enterprise 

Undated 

MS Excel spreadsheet 

SCVWD 

January 28, 2005 

PDF document 

SCVWD 

May 4,2006 

PDF document 

SCVWD 

For Year Ending December 31, 

2006 

Hard copy 

SCVWD 

March 29, 2006 

PDF document 

AWWA 

December 22,1998 

Hard copy 

AWWA 

September 1998 

Hardcopy 

SCVWD - Administration 

January 30, 2006 

MS Word document 

SCVWD - Water Utility Operations Division 

2004-2005 

MS Word documents 

SCVWD - General Services Division 

Received November 10, 2005 

MS Word document 

SCVWD - General Services Division 

Received November 10, 2005 

MS Word documents 

SCVWD 

Undated 

MS Word documents 

SCVWD - General Services Division 

Received November 10, 2005 

PDF document 

SCVWD 

Undated 

MS Word document 

SCVWD - Administrative Services Division 

Received November 10, 2005 

Hard copy 

SCVWD - Administrative Services Division 

Received November 10, 2005 

Hard copy 

Government Finance Officers Association (GFOA) 

Various 

GFOA website: 

http://www.gfoa.org/services/cp/ 

SCVWD - Administrative Services Division 

Received November 10, 2005 

Hard copy 

SCVWD - Administrative Services Division 

Received November 10, 2005 

Hard copy 

SCVWD - Administrative Services Division 

Received November 10, 2005 

Hard copy 

SCVWD - Administrative Services Division 

Received November 10, 2005 

Hard copy 

SCVWD - Administrative Services Division 

Received November 10, 2005 

Hard copy 

SCVWD - Human Resources Division 

Undated 

MS Word document 

SCVWD - Human Resources Division 

Various 

Various 

SCVWD 

September 23, 2003 

PDF document 

Maze &c Associates 

June 17, 2005 

Hard copy 

SCVWD 

January 15, 2004 

MS Word document 

SCVWD - Human Resources Division 

November 15, 2005 

Hard copy 

SCVWD - Financial Services Division 

Received September 30, 2005 

PDF document 

Santa Clara County Board of Supervisors, Management 

Audit Division 

July 12, 2005 

PDF document 

SCVWD - General Services Division 

November 23, 1988 

Hard copy 

SCVWD 

2002 

Hard copy 
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B. If the audit discloses any condition that would preclude an opinion on the performance of 
the District or any suspected or actual malfeasance or irregularities, the Consultant will 
immediately and simultaneously notify the Chair of the Board’s Ad Hoc Audit Committee, 
the District’s Chief Executive Officer, and the District Counsel that such condition exists or 
is suspected to exist. Such irregularities include but are not limited to theft of District 
property, defalcation of funds, falsification of records, illegal activities, or significant 
deficiencies in the internal controls of the District over funds or other assets of the District. 

V. Standard Definitions (per GAO General Accounting Standards) 

• “Criteria”: The required or desired state that is expected from a program or operation. 

* Condition : The actual state that is discovered in a program or operation. 

* Cause ’: The factor(s) responsible for the difference between conditions and criteria; 
backed by persuasive evidence 

• Effect : The impact of the difference between conditions and criteria 

VI. District-Provided Services and Responsibilities 

The District has designated Mr. Peter Sakai, Chief, Office of Performance Excellence, as the 
Contract Manager, on behalf of the Chair of the Board’s Ad Hoc Audit Committee. Director 
Larry Wilson. The District Contract Manager will be responsible for reviewing the 
Consultant’s invoices for payment and monitoring the Consultant’s performance. 

Ms. Olga Martin S t eele , Chief Administrative Officer, will serve as the District Project 
Manager. The District Project Manager will be responsible for the following 

A. Providing maps and/or directions to any District offices, interview locations, or 
facilities to be visited other than District headquarters 

B. Providing necessary briefings of project purpose, involvement necessary, interview 
format, and other staff awareness/orientation information to District employees 
involved with the Consultant’s on-site activities. Specifically, the District will 
conduct its own briefings at the beginning of the audit, as well as prior to each of the 
10 main audit tasks as defined in this scope of work and listed below. The District 
may elect to combine some of these or otherwise determine the most effective way 

' to deliver the necessary briefings to these main audit groups: 

3.3.1 Administrative Services 

3.3.2 Financial Services 

3.3.3 General Services 

3.3.4 Information Management 

3.3.5 Human Resources 

3.3.6 Risk Management Program 
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3.1.4 Conduct audit fieldwork/desk work 

• Conduct individual interviews with remaining five (5) Board members 

• If necessary, conduct follow-up telephone interviews with Board Chairman 
and Audit Committee Chairman 

8 Conduct interviews with other stakeholders (5) including representatives of 
Harvey M. Rose Accounting Corporation, at least one water retailer, and 
possibly Santa Clara County officials 

• Execute specific audit tasks and draft findings for each 

• Review findings in field with those directly involved, if possible, and 
document feedback 

3.1.5 Prepare memorandum of findings 

• Prepare draft for internal team review 

« Revise and review with appropriate client representatives (validation meeting) 

• Finalize memorandum of findings 


Task 3.1 Assumptions 

Meetings: 2 total (1 Board meeting and 1 validation) 
Interviews: 12 individual in-person intennews 
Deliverables: 1 preliminary draft and 1 final draft 
memorandum of findings, delivered electronically 


Progress Milestone 


: $ 22,102 


3.2 Chief Executive Offices 


Key Audit Objectives: 

Assess the effectiveness and efficiency of the CEO’s reporting of compliance with the 
Board’s Ends and Executive Limitation Policies (closely related to Task 2.3) 

Review the District’s customer/partner relationship management practices: 

• Assessment of existing practices and comparison with best practices and relevant 
benchmarks: 

° Effectiveness in conveying District views and positions in the media 
° Effectiveness of the District in influencing water related policies at the 
Local, State, and Federal levels 
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Section 6 
Prioritization of Findings 


coordination or intra-District agreement or action required to complete the task. A 
recommendation that can probably be addressed within one working group with little 
outside consultation or coordination, for example, is in category “A.” Tasks that will 
likely require moderate coordination with one or two other divisions or other internal 
stakeholders are in category “B.” A task that would likely require extensive coordination 
between many District units and/or executive leadership to complete the task was assigned 
to category “C.” For reference, the main Baldrige categories associated with each finding 
are also indicated in the following table; this is the same information presented in the 
“References” notes in each of the “Criteria” boxes of the appended individual audit 
findings. 

Red Oak’s intent at the start of this audit was to assign priorities to each recommendation 
in this audit report. The relative scoring process as described above was done instead for 
two main reasons. First, as noted in this report and as discussed at the October 3, 2006 
Audit Committee meeting, the District began addressing some of the most significant 
findings of this audit quickly—specifically, during or just after audit fieldwork and prior 
to Red Oak’s preparation of this report. Therefore, a prioritization process conducted by 
Red Oak for the purposes of this report would be somewhat moot. Furthermore, both Red 
Oak and the District concluded that the most effective prioritization process would take 
place not during the preparation of this audit report by Red Oak, but rather in an 
interactive setting involving the Baldrige Champions (as discussed in Section 3). As a 
result, Red Oak developed the relative scores for conditions and recommendations 
associated with each finding. Red Oak’s intent is that this will provide the District with a 
useful foundation for implementation. This list is also being provided to the District 
electronically for its use in sorting, prioritizing, and tracking each of the items. 
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7. Baldrige Category 1 - Leadership 


The Baldrige program defines “leadership” as “ how [an] organization’s senior leaders 
guide and sustain [the] organization, [the] organization’s governance, and how [the] 
organization addresses its ethical, legal, and community responsibilities. ” 

The discussion below is based primarily on individual audit findings presented in the 
Board, CEO, Administration, and Finance audit memoranda appended to this report. 


7.1. Policy Governance 


The District is governed in accordance with the Carver Policy Governance Model. This 
model is characterized by key departures from the traditional board model of governance. 
Most notably, it calls for limited board involvement in near-term organizational planning 
and execution, directly relates CEO performance to organizational performance, and relies 
primarily upon the CEO to interpret and implement board policy. Some of the critical 
elements of the District’s application of the model include: 

® The Board develops “ends” and “limitation” policies for the CEO. The CEO is 
then expected to create a strategy to accomplish the ends within the given 
limitations. 

• The performance of the CEO is regarded as identical to the District’s 
performance. 

• The Board relies upon the CEO’s interpretation of the Board’s policy directives 
in order to accomplish the ends. Such reliance is predicated on the strong 
leadership and effective communication skills of the CEO. 

7.1.1. Roles of the Board and the CEO 

As part of the Carver policy governance model, the CEO is responsible for educating 
executive managers on the model and the Board’s Ends Policies and Executive Limitations 
to ensure that the governance procedure is carried through to the staff level at the District. 
Red Oak found that the District’s executive team is highly experienced, dedicated, and 
supportive of the CEO, and well-versed in the theory and practice of policy governance. 
The CEO regularly briefs his executive team immediately following Board meetings, 
keeping them informed about Board decisions and Board/CEO interaction and ensuring 
their high level of awareness of the District’s policy governance approach. As a result, the 
executive management team members, specifically, the chiefs of the District’s four main 
enterprises/departments (Administration, Watershed Operations, the Water Utility 
Enterprise, and Capital Program Services) are very clear on the respective roles and 
responsibilities of the Board and the CEO, and on the Board’s Ends Policies and Executive 
Limitations. (See Appendix B - CEO Audit Memorandum Finding No. 1.) 
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Section 7 

Baldrige Category 1 - Leadership 


As there is strong communication between the executive team and the CEO, Red Oak also 
found evidence of a strong link between the CEO and the Board of Directors. The District 
emphasizes the CEO’s responsibility to the Board according to the policy governance 
model and has made CEO/Board communication a priority. The CEO has accepted the 
responsibility of reporting accurate and complete District performance and status to the 
Board. (See Appendix B - CEO Audit Memorandum Finding No. 2.) 

7.1.2. Ends Policies 

The success of the Carver governance model is contingent partly on the appropriate choice 
of Board Ends Policies. These policies must set expectations for all major operational areas 
of the District to facilitate CEO interpretation and set level-of-service expectations at the 
manager and staff level. Red Oak found the District’s performance in this regard to be 
mixed. Specifically, a number of policies/CEO interpretations directly reflect the District’s 
core activities and are developed to an appropriate level of specificity. The District’s 
policy/CEO interpretation regarding water supply reliability is one example. On the other 
hand, other policies/CEO interpretations are not yet sufficiently defined or do not cover all 
major areas of the District’s core businesses. For example, there is not a Board Policy 
governing the area of floodplain management, an area in which the District has significant 
involvement. It is necessary for the Board to develop a clear definition of core services and 
level-of-service with respect to flood protection for Watershed Operations and clarify the 
definition of how the District participates and supports floodplain management in Santa 
Clara County. (See Appendix E - Watershed Operations Audit Memorandum Finding No. 
1 .) 

Furthermore, the Board and District leadership should make it clear that all organizational 
areas play a part in the achievement of the District’s Ends Policies and compliance with its 
Executive Limitations. Specifically, Board policies, CEO interpretations, and 
organizational performance measures (discussed later in this report) should reflect the 
participation of Administration in the delivery of the District’s water, watershed, and 
capital services. In Baldrige terminology, all organizational areas should be part of the 
“value-creation process” and tied directly into the measurement and success of the 
organization as a whole in achieving its objectives. In other words, program goals should 
be emphasized first and foremost at the District—department and unit-specific missions, 
goals, and outcomes should exist only secondarily, that is, to support agency-wide goals, 
and to avoid having department or unit managers having competing interests. 

7.1.3. CEO Interpretation of Board Policies 

Along with strong communication with the Board and the executive team, the CEO is 
responsible for translating the Board Policies for staff for use in day-to-day District 
operations (as outlined in Board Policy EL-9). The CEO’s interpretations of the Board’s 
Ends Policies should be clear to all executive managers and translated into the day-to-day 
operations of the District in the form of business plans, individual work plans, or other 
quantifiable performance plans and indicators, for example. 
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Section 10 

Baldrige Category 4 - Measurement, Analysis, and Knowledge Management 


information between the two systems; however, the District should identify all high-usage 
processes that involve the transfer of information (e.g., purchase orders, maintenance 
work orders) between systems and develop an integration plan. Potential integration 
targets are as follows: 

s Geographic Information System - Computerized Maintenance Management 
System (GIS-CMMS) 

® Geographic Information System - Water Resources Information System (GIS- 
WRIS) 

• Computerized Maintenance Management System - Enterprise Resource Planning 
System (CMMS-ERP) 

• Computerized Maintenance Management System - Supervisory Control and Data 
Acquisition System (CMMS-SCADA) 


This plan should focus on a standardized methodology for system integration using a 
common data architecture or enterprise application integration product. In essence, the 
District needs to take more complete advantage of its existing technology to enable staff to 
quickly execute routine, transactional business tasks and focus on their primary, higher- 
level duties. 

10.1.2. Budgeting Automation 

The District recently acquired a well-established automated enterprise accounting system. 
Although there were some initial implementation difficulties, and the District’s needs 
dictated the development of a customized budget module instead of the standard package 
module, the system is now integrated into the business processes of the District. Financial 
reporting and control have been successfully carried out using the new system. This is 
discussed in more detail in the appended Administration audit memorandum. 

Implementation of ancillary operational support systems such as cost accounting, 
integration with the work-order system, and timekeeping for treatment plant staff is not 
yet complete. The operating business units have made some progress in developing cost¬ 
accounting functionality in the system. The District should, through a CFO, work with its 
Information Management Division to integrate this sort of support and system 
development into a strategic plan for the District’s finance function. The District should 
establish a target completion date for the operational support systems noted above and 
reflect this in the business plans for the Information Management and Finance Divisions. 
Once the strategic plan is completed and schedules determined, it is important to manage 
work processes by determining outputs, determining their costs, recording measurement 
data, providing internal reports, and validating data. An approach that focuses on the 
development of cost accumulation and analysis processes based on defined business 
outcomes (top-down) is generally more efficient than approaches that seek to build cost 
data from the bottom up. 
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Section 10 

Baldrige Category 4 - Measurement, Analysis, and Knowledge Management 


10.1,3. Geographic Data Management and Modeling Tools 

The District would also benefit from developing a consolidated approach to geographic 
data management in the areas of property management tools. The District’s Real Estate 
Unit currently has an Oracle database-based property management program 
(“RESPECT”) used to track the District’s property holdings. This program allows the 
District to perform its basic property management functions. However, it requires 
excessive quality control and is antiquated in terms of functionality, data management 
speed, and mapping/visual capabilities with respect to the “state-of-the-practice” among 
the District’s peers. Red Oak understands that the District has GIS technology and 
resources in place; however, the state of the property management system indicates that 
GIS has not yet been deployed in all areas of the District where it can provide a significant 
benefit. The District should expand the capabilities of its current District-wide GIS 
application to aid the Real Estate Unit in creating an updated property information 
management system. 

In addition, the District’s watershed hydrologic and hydraulic models are not consistently 
integrated and up-to-date. This impacts operation and maintenance activities because the 
impact of field operations cannot be evaluated easily. It can also limit the ability to 
consider the linkages between flood-protection projects located within a common 
watershed planning area. The impacts of land use changes on watershed hydrology are 
difficult to assess and manage without integrated and up-to-date models. A current model 
could also provide a single source of hydrologic design flows that can be used for channel 
capacity evaluations performed by the District, local communities, or private improvement 
projects. 

The District’s Real Estate Unit currently uses a hard-copy document management system 
to organize, store, and maintain all files relevant to District properties. For the past three 
years, the Real Estate Unit has been putting effort into having the budget allocated for 
implementation of an Electronic Data Management System (EDMS) to aid in maintaining 
necessary documentation that characterizes the District’s parcels. The Real Estate Unit is 
currently looking into using a version of the “QUESTYS” program used in the Clerk of 
the Board’s Office and is aware that the CADD Services and Records Sc Library Units are 
also looking into a similar program. Red Oak recommends that the District undertake a 
document management strategy at the governance/leadership level. This management 
system should be integrated in the District-wide strategic plan and incorporate the 
document management needs throughout the District. 

Furthermore, District real estate files—both public information such as property deeds and 
private information such as resident relocation files—should be organized in an electronic 
document management system to improve and control accessibility to the documents. Red 
Oak understands the District is moving in this direction. 

The District should place a strategic emphasis on facilitating employee use of existing 
knowledge management tools. This includes deploying key systems/tools throughout the 
District where needed (e.g., GIS, property management, and hydrologic/hydraulic models), 
integrating high-usage processes through District-wide software (e.g., procurement 
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13. Views of Responsible Officials 


In order to ensure that this audit report is fair, complete, and objective, Red Oak has 
obtained, and included in this section, comments from key District officials (“responsible 
officials” in GAGAS terminology) on the final audit findings presented in this report. 
These comments represent the District’s official views on Red Oak’s audit findings “above 
and beyond” the validation feedback provided to Red Oak during the various validation 
phases throughout the audit. By including these views, this audit report not only presents 
the District’s strengths and opportunities for improvement as described by Red Oak, but 
also the direct perspectives of District officials on the audit findings—including any 
additional information they have elected to provide regarding the District’s 
implementation of the recommendations presented in this report or what alternative 
actions they may be considering. 

As noted in earlier sections of this report, this section is particularly important because the 
District has taken a number of actions since the time of Red Oak’s audit fieldwork to 
address several of the most significant recommendations in this audit report. 

GAGAS addresses this practice as follows: 

“Auditors should report the views of responsible officials of the audited program 
concerning auditors’ findings, conclusions, and recommendations ; as well as planned 
corrective actions. One of the most effective ways to ensure that a report is fair, 
complete, and objective is to obtain advance review and comments by responsible 
officials of the audited entity and others, as may be appropriate. 

“Including the views of responsible officials results in a report that presents not only 
the auditors’ findings, conclusions, and recommendations, but also what the 
responsible officials of the audited entity think about the audit results and what 
corrective actions officials of the audited entity plan to take. Auditors should include 
in their report a copy of the officials’ written comments or a summary of the 
comments received. ” (Emphasis added.) 

Throughout the audit Red Oak worked with the District CEO, executive management 
team, and individual auditees to: 

1. Ensure the factual accuracy of the findings presented in this report; and 

2. Ensure that Red Oak’s recommendations incorporated the appropriate 
organizational context and reflected any pertinent corrective actions the District 
had initiated at the time of the audit. 

The District’s responsible officials were given the opportunity to submit written responses 
to Red Oak’s audit findings, which, by definition, include the five necessary components 
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Section 13 
Views of Responsible Officials 


as described in this report: criteria, condition, cause, effect, and recommendation (where 
appropriate). 

It is Red Oak’s intent that readers of this audit report will consider the District’s views as 
presented on the following pages an integral component of this audit report. Furthermore, 
any further distribution of excerpts from this report that include Red Oak findings should 
be considered incomplete unless accompanied by the District’s viewpoint as it relates to 
those findings. 
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confidentiality and privilege concerns. 

Admin 28 

OFI 

Update/improve 
Information Technology 
master plan 

Audit Recommendation: The District should revisit the ISMP and update 
it based on current conditions. Using “lessons learned 1 ' from the 

PeopleSoft implementation and other ISMP projects, the District should 
develop a pragmatic view of its IT projects over the next three years and 
determine budgets, schedules, and dedicated staff requirements. This 
update of the ISMP should involve more detail than currently exists and 
should take into consideration the interdependencies on other IMD and 
District-wide projects/initiatives. Dedicated staff should be identified and 
reserved through the use of BPAs as discussed in an earlier finding in this 
memorandum. The broader recommendations made elsewhere in this 
memorandum regarding planning and prioritization District-wide will also 
yield benefits with respect to ISMP management and implementation. The 
District appears to be on an appropriate course with respect to its 
development and full, consistent implementation of its District-wide 
budgeting tool. 

District View: 

New initiative needed. 

Disagree: Condition 

The ERP project schedule was extended to accommodate unforeseen 
business changes such as District reorganization and reclassifications for 
EA and Mid-Management. The overall 17 months is longer than what the 
ISMP plan originally stated, but was under the 18-24 months industry 
average for similar implementations. The overall cost of the 
implementation is half that of a similar implementation at the City of Santa 
Clara during the same time period. Services and supplies are within 
budget. The extra cost for staff labor was due to the aforementioned 
delays. 

Disagree: Recommendation - Inter-departmental coordination 

This needs substantial effort across organizations and needs direct 
involvement at the Leadership Team level and/or above. 

Admin 31 

OFI 

Automate remaining 
paper-based processes; 
revisit underlying work 
practices 

Audit Recommendation: The District should identify all high-usage 
processes that involve the transfer of information yet still use paper-based 
processes (e.g., purchase orders) and develop a plan to automate these 
using existing systems. This plan should not be limited to configuration of 
systems, but should also include business process optimization to 
eliminate unnecessary steps. 

With respect to the CAS, the District should consider refining the tool to the 
extent it is possible to continue to achieve its original goals plus 
incorporate potential improvements identified by users to date. It is Red 
Oak's experience that organizations who implement major new systems 
can benefit substantially from conducting a purposeful refinement after the 
initial implementation and first year of use or so, to take advantage of that 
initial experience and apply any lessons learned. 

During the finalization of this audit memorandum, District staff also noted 
that some systems such as the CAS and the budgeting tool noted in 
previous findings are currently not maintained within the Information 


6 














PROSPECTOR 2004 

Strengths 

Areas for Improvement 

Policy Governance 

Lack of Systematic ADLI (Approach, Deployment, 

There is a systematic process that establishes 
Board policies and provides direction to the 
CEO, and which are part of the public record. 

Learnina, and Integration) 

Processes, such as complaint management, are 
in early stages of approach and deployment. 

Collaboration 

Important process with both Board/staff 
relationship and between management and 
bargaining units. 

Data on Several Key Areas Not Found 

Early stages of deployment. 

Knowledge Management 

Creation of Office of Organizational 
Development with program to collect and 
transfer employee knowledge. 

Lack of Comparative Data 

Not found in most areas. 

Some Positive Data Trends 

Some performance factors have data over 
time. 
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Performance: 4.1b(l) 

Condition 

The Board has not developed an effective ends or limitations policy to 
establish and manage the administration of the District’s reserve funds and to 
provide guidelines for the funding and financing of capital projects. 

Cause 

The Board has not prioritized the establishment of such a policy. 

Effect 

The Board has not developed clear policy statements regarding how the 
District should fund and finance its capital projects, that is, the proportion of 
“pay-as-you-go” financing vs. debt financing, which can be interpreted as an 
issue of inter-generational financial equity vs. creditworthiness. The Board 
also has not developed a clear policy regarding the establishment and 
maintenance of reserve funds. As a result, the reason for the District’s current 
policy-level approaches to these matters is not clear, to internal staff and to 
external interested parties. 

Recommendation 

The Board should establish a policy to establish and effectively manage 
reserve funds and to provide guidelines for capital projects funding and 
financing. If necessary, an outside consultant should be retained to provide a 
clear range of alternatives and facilitate the Board’s discussion and 
development of such a policy. The Board should consider generally 
increasing its oversight of the District’s financial affairs, perhaps via a Board 
Committee tasked with overseeing the CEO/District’s compliance with 
Board-imposed financial policies and objectives. 


Finding No. 4 - Opportunity 


Criterion 

The Board should regularly assess and evaluate the effectiveness of the 
Board and its members with respect to conduct, effectiveness, and areas of 
improvement. 

Reference: 

• Board Policies: GP-6 and GP-7.7 

Baldrige Governance and Social Responsibilities: 1.2a(2) and 1.2b(2) 

Condition 

The Board currently lacks a process to evaluate the effectiveness of its 
operations. In the event that Directors think that a member or the Board as a 
whole is ineffective or acting inappropriately in a public setting, their only 
means of recourse is to review the Board policy pertaining to the areas 
needing improvement. However, this does not provide them with a means for 
addressing the root causes of the particular problem or provide an avenue to 
monitor improvement. 

Cause 

The Board of Directors has not prioritized the issue of evaluation and 
assessment with respect to the conduct of its members. 


Page 8 of 13 


October 11, 2006 







Cause 


Cause 

The Board is composed of experienced and long-time members who have not 
made a formalized Board member training program a priority, though it is 
called for in the policy manual. Consequently, tire need for formalized 
training has been limited. Therefore, any new Board members may be at risk 
for simply learning “on the job,” rather than also attending formal education 
and training sessions as an integral part of their job as Board members. 

Effect 

The sustainability of the current level of Board communication and 
effectiveness may be at risk. The risk could result from new members joining 
without receiving orientation and training, and attempting to fulfill their 
duties inconsistent with the Board’s adopted policy governance approach. 
The effectiveness of the Board could also be threatened by the fact that the 
District is a large and complex organization that requires oversight from 
directors kept abreast of issues of financial oversight, changes in legislation, 
and methods of modifying their governance model and structure. 

hi addition, in order to be effective, Board members must be able to achieve 
the objectives they have set for themselves and their constituents. Using 
traditional methods of direct influence and active direction contradicts the 
District’s governance policy; however, most officials from outside the 
District would likely be experienced only in traditional approaches. If new 
Board members are not helped to leam how to use the policy-setting process 
to achieve their objectives, the governance model could eventually become 
unacceptable to them and discarded. A systematic training process will also 
benefit the District, by providing current members an opportunity to 
strengthen their skill sets and stay abreast of changes in finance, governance 
tools, and policy. 

Recommendation 

The Board should establish a formal training and orientation program to 
ensure that current and, perhaps more importantly, future Board members 
participate in orientation as new members, and regular training as established 
members. Training should include the Brown Act and the fomial ethics 
training mandated by the enactment of AB 1234 in 2005. 

Finding No. 6-0 

pportunity 

Criterion 

The Board should not use committees to exercise direct authority over 
District staff. 

Reference: 

• Board Policy: GP-8 

Condition 

As discussed earlier in this memorandum, the Board maintains nine advisory 
committees. These committees are intended to serve as a link to the 
community by which the Board members can take into account the desires of 
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Condition 

According to Board policy, “The Board, as a whole, will view CEO 
performance as identical to organization performance, so that organizational 
accomplishment of Board stated ends and avoidance of Board-prescribed 
means will be viewed as successful CEO performance.” The Board also 
charges the CEO with interpreting ends policies, and creating an executable 
strategy to accomplish the objectives of the ends policies. With the 
submission of the Fourth Quarterly report each year, the Board evaluates the 
annual accomplishments and effectiveness of the CEO and thus the District. 
However, the reliance on CEO interpretation to set and judge the 
performance of the District results in the District not having any objective 
standards by which to judge the performance of District operations and 
effectiveness. 

Cause 

The lack of Board-driven performance measures associated with the Board’s 
Ends policies is the cause of the condition noted above. 

Effect 

The current process of evaluation provides the Board a limited scope of 
measures by which to evaluate the District because there is no empirical 
standard by which to measure the progress or regression of District 
performance. According to the CEO, “it is not automatic that if you 
accomplish all of the goals of the Board then the organization is optimized.” 

Recommendation 

The Board should strengthen its evaluation process of the CEO and District 
by establishing performance measures for Board Ends policies and creating 
an annual CEO performance workplan. The CEO workplan should be an 
outcome-based tool that clearly supports and interprets the Board policies 
and can be used to guide the activities of the executive team. 


All findings presented in this memorandum, particularly the recommendations, are to be 
considered as one component of the final audit report prepared by Red Oak. 

Views of Responsible Officials 

“Views of Responsible Officials” are included as a component of the main body of the final audit 
report. 

1 

Nature of Any Privileged or Confidential Information Omitted 

No privileged or confidential information was omitted from this audit memorandum. 

References 

The reference list for this and all audit memoranda is included in the main body of the final audit 
report. 
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1. Introduction 

The District contracted with Red Oak to conduct a performance audit of the District. The audit 
fieldwork and this series of memoranda were structured according to the District’s organization, 
using a “top-down” approach begimiing with the Board of Directors. Red Oak and the District 
recognized that many audit findings and recommendations would involve one or more 
organizational units. Therefore, these memoranda were initially presented as interim, preliminary 
drafts and remained so until the completion of the audit. Upon completion of all audit fieldwork, 
Red Oak finalized the interim findings/recommendations presented in this and the other draft 
memoranda. Therefore, this memorandum is to be considered as one component of Red Oak’s 
final audit report to the District. 

2. Objectives, Scope, and Methodology 

Red Oak conducted the Comprehensive Performance Audit according to Generally Accepted 
Government Auditing Standards (GAGAS). As a result, this memorandum was prepared in 
accordance with the GAGAS Reporting Standards for Performance Audits (USGAO, 2003). 
Additionally, per the scope of work, Red Oak’s audit included a review of systems and processes 
for internal controls; examination of documents and records; interviews with staff, customers, 
and stakeholders necessary to evaluate the District’s compliance with applicable laws, 
regulations, and policies; and evaluation of the effectiveness and efficiencies of the District’s 
policies, procedures, and practices for financial, administrative, and operational management, 
and capital planning and management. 

The key audit objectives for the Administration audit provided to Red Oak by the District were 
as follows, as indicated in Task 3.3 of the scope of work: 
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Condition 

Board Policy EL-7.2 states that the CEO shall not “fail to maintain 
District self-insured risk retention for liability at $2 million with 
reserve funding at a level of 95 percent actuarial confidence...” Based 
on the experience of the Red Oak team with successful risk 
management strategies in place at similar organizations, the District 
Board and/or CEO has established a sufficient but perhaps overly 
conservative and relatively inflexible approach for assuring that 
adequate funds are available to cover loss payments. Reserves are 
reduced by discounting to the net present value of the future loss 
payments based on commonly accepted actuarial practice. 

Cause 

The District has adopted this funding level as a prudent and 
conservative measure to assure availability of funds to pay for losses; 
however, the District has not taken the opportunity to build in 
additional flexibility. 

Effect 

This practice assures budget stability, compliance with GASB 
Statement No. 10, and ability to meet obligations when they arise. 
Requiring funding to such a high confidence level also helps prevent 
occurrence of a major problem with self-insured funding, which is the 
temptation to use funds that should be earmarked for future liabilities 
to pay for present needs or wants. Discounting the reserves (reducing 
the required amount to the present value of the ultimate liability) 
mitigates the degree to which the funding level would be considered 
overly conservative. 

However, funding to this high a confidence level is less common - and 
more costly - than funding to a more moderate level of confidence, 
such as 70-75%. 

Recommendation 

According to the RMA, the District is considering changing EL-7.2 to 
allow flexibility in the confidence level setting. We recommend doing 
so, and considering a minimum confidence funding level according to 
a more moderate level of confidence in line with standard industry 
practice. The actual target could be flexible: raised when circumstances 
warrant, such as when District finances are healthy and insurer- 
required self-insured retentions are high; and lowered when conditions 
are appropriate - such as when insurance market conditions make 
coverage relatively affordable or when the District has the need to 
reallocate resources. However, short-tem financial need should never 
be used as reason to reallocate funds encumbered for covering 
liabilities. 

Along with introducing flexibility in setting confidence levels, the 
District should consider flexibility in setting the amount of retained 
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Finding No. 31 - Opportunity 

Key audit objective: “Information management” 


Criterion 

The District should have current-generation software applications to support 
the core functions of the organization. These applications should support the 
automation of work processes and be adaptable to work process changes. 

References: 

• Baldrige - 4.2: Measurement, Analysis, and Knowledge 

Management 

Condition 

The District maintains the core applications that are industry-standard for a 
public water agency (e.g. financials, customer information system, GIS, 
CMMS, WRIS, electronic document management, contract administration). 
One exception is the lack of a standard budget module for the District-wide 
ERP system, although the District elected not to procure one initially by 
design, and has developed and deployed a budget tool for District-wide use 
as discussed in Finding No. 28 of this memorandum. 

However, some of the key business processes have not been fully automated. 
For instance, purchase orders and maintenance work orders in Watersheds 
and Fleet are still routed using paper, indicating the District is behind the 
best practice in this regard. The District also has the opportunity to further 
improve its existing level of automation where it already is at the state-of- 
the-practice; for example, it could enhance its use of GIS and CADD by 
adding a “red-lining” tool for providing electronic feedback and change 
requests on drawings. It was noted that in other areas, however, maintenance 
work orders are automated; for example at the plant and within the building 
facilities group. 

In addition, the District implemented a Contract Administration System 
(CAS) to automate the collection of certain data and information to produce 
reports, allow for monitoring of contract agreements, create vendor lists, 
enable on-line vendor applications, and provide other features. It was beyond 
the scope of Red Oak’s audit to review this tool in detail, but consistent 
verbal input indicates that users experience a fair amount of frustration in 
using the CAS tool and that, to date, the implementation of CAS has had 
mixed results. This may be the result of the users not understanding the true 
purpose of the system, the system having been designed with insufficient 
attention to user needs, or other factors. It may be the case that CAS is 
fulfilling its initial goals, but that the District has an additional opportunity to 
perform follow-on refinements to the tool to further streamline the associated 
business processes and take advantage of feedback from its implementation 
to date. 
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introduced and passed that will relieve the District of the responsibility of 
gaining budgetary approval by the Board of Supervisors each year, effective 
January 1,2007, as noted in the main body of the final audit report. 

Red Oak believes that SCC/MAD makes certain observations regarding 
budgetary control and authority that, once raised, must be dealt with by the 
District affirmatively. In particular, if delegation of budgetary authority to 
the CEO is to be continued at the current level, care should be taken that any 
significant deviations from the Board-approved budget be reported on a 
regular basis to the Board. This approach balances the need for efficiency 
with the assurance that the Board is informed of the purposes for which 
District resources are being used. District legal counsel should explicitly 
review and agree to the legality of the current delegation approach 

The SCC/MAD report recommends that the District: 

1. Implement an expedited budget calendar to allow the Board of 
Supervisors sufficient time for appropriate review. 

2. Include estimates of current-year financial results, including fund 
balances, in the proposed budget, and update those estimates based 
on new information during the budget process. 

3. Include an analysis of labor costs by position and functional area in 
the proposed budget. 

4. Present more complete quarterly financial management reports. 

5. Ensure approval by the District Board of key planning documents. 

6. Provide key planning documents to the Board of Supervisors on an 
annual basis. 

These are reasonable suggestions that the District should consider in the 
context of cost of implementation and the expected value to be achieved. 

At the time of this audit fieldwork, Red Oak encouraged conformance of the 
budget calendar to the County’s needs, as already agreed to by the District. 

The proposed budget would be greatly enhanced by up-to-date estimates of 
current year results, including fund balances. If there is a high level of 
uncertainty, the estimates can be made on a conservative basis. 

In the context of the District’s governance structure, Red Oak does not agree 
that a detailed distribution of labor costs by position would add significant 
value to the District Board’s deliberations. This is a matter better delegated 
to the CEO, who is then held responsible for achieving Board-mandated 
performance results. 

As stated earlier, it is important that material deviations from the Board- 
approved budget be reported on a quarterly basis. Authority to make those 
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Cause 

The District’s Board policies emphasize compliance. 

Recommendation 

Investment performance should be measured against appropriate benchmarks 
as determined by the type of investments allowed and actually made. The 
LAIF index and County portfolio should be evaluated to determine if they 
serve that purpose. Consideration should also be given to using professional 
investment management if better performance within guidelines can be 
expected. This can be determined through the benchmarking process. 

FINDING 1.0(g) 

- Internal Service Funds 

Criterion 

Generally Accepted Accounting Principles for government require the use of 
appropriate fund types for specific activities. In addition, the determination 
of internal charges from internal service funds to user departments should be 
made on a fair and equitable basis reflecting cost responsibility. 

Condition 

These funds are used in accounting for quasi-external transactions such as 
equipment maintenance and risk management. The Financial Services 
Division computes charges to operating divisions based on full cost recovery 
and an allocation of cost responsibility. No benchmarking is conducted. 

The District appropriately uses this fund type and computes charges 
correctly. However, by their very nature, activities that are appropriately 
accounted for as internal service funds are candidates for outsourcing. 
Without benchmarking, the “make-or-buy” decision cannot be optimally 
considered. 

Effect 

In general, charges for services provided by these funds are reasonable and 
defensible from a cost-allocation standpoint. The actual costs incurred by the 
funds are not critically evaluated by the District. 

Cause 

Calculation of charges is conducted annually by the Budget Office in 
coordination with Internal Service fund managers and staff. 

Recommendation 

At regular intervals (2-3 years), an effort should be made to benchmark 
internal service fund charges to available alternatives in the private sector. If 
benchmarking indicates outsourcing may be competitive, solicitation of 
proposals should be considered. Red Oak recognizes that the District already 
performs some degree of consideration of outsourcing on a case-by-case 
basis as noted in other audit memoranda; however, the analyses have not 
been conducted based on internal service fund benchmarking as described 
here. 
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Recommendation 

Under the direction of a CFO, plans should be developed for moving the 
Financial Services function toward more proactive support of strategic 
activities at the District. 

jfp 

j, 

FINDING 6.1(a) 

j 

i • 

Criterion 

GAO Practice 6: Organize finance to add value. 

i • 


GAO Practice 6, Key Point 1. The finance department’s mission supports 
the entity’s business objectives. 

U 

n 


GAO Practice 6, Key Point 2. The organizational structure and human 
capital strategies support strategic business unit needs as well as 
traditional controllership and transaction processing functions. 

: 


The District should exhibit these GAO Practice characteristics. 

f: 

Condition 

There is a strong connection between the District’s operating goals and 
objectives, Board Ends policies, and the budget process. In addition, the 
organizational location of certain business functions in the operating 
divisions provides support for strategic activities. However, Financial 
Services does not have an explicit vision and supporting goals and objectives 
for this process. 

I j 

f 

j ■: 

r 

J 

| 

1. 


The outplacement of business functions has been the result of “pull” from 
operating division managers rather than a conscious strategy by District 
leadership or Financial Services. The connection between the budget and 
strategic policies and goals has been driven by the Board’s governance 
policy. While this is an effective way to align financial management with 
business goals, there is evidence that the out-placed groups are being pulled 
into the basic accountability and control (e.g., budget preparation) due to lack 
of resources in Financial Services. 

v: 

G 

ty ,"v 

iV: 

Effect 

Financial support of operation is accomplished effectively through the out- 
placed business groups. 

ft 

h. 

Cause 

The CEO and operating group managers have recognized that financial 
support of operations is essential. Lack of a strong financial management 
position has made the outplacement approach essential for the 
accomplishment of that goal. 

1 

[ 

r 

Recommendation 

Under the direction of a CFO, Financial Services should take a proactive role 
in forging a link between its functions and activities and the business 
objectives of the District. If out-placed groups are the method for this 
process, care should be taken to preserve that function. Basic financial 

L... 
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FINDING 7.2(a) 


Criterion 

GAO Practice 7: Develop systems that support the partnership between 
finance and operations. 

GAO Practice 7, Key Point 1. The general ledger system is integrated 
into business processes and is adequate for financial reporting and 
control. 

GAO Practice 7, Key Point 2. Automated systems are designed and 
deployed that (1) accurately measure the costs of activities, processes, 
products, and services and (2) provide line managers with timely, 
accurate financial and non-financial information on the quality and 
efficiency of business processes and performance. 

GAO Practice 7, Key Point 3. An enterprise-wide system integrates 
operating, financial, and management information and allows decision 
makers to access relevant information easily and perform ad-hoc data 
analysis. 

The District should exhibit these GAO Practice characteristics. 

Condition 

The District’s current systems do not provide comprehensive cost accounting 
tied to organizational outputs or objectives, nor do they relate non-financial 
and financial information in a manner designed to allow measurement and 
evaluation of operational performance. 

The District has not developed a financial information system to support its 
efforts in defining performance goals and measuring performance. 
Compilation of information for these purposes is arduous and generally done 
on an ad-hoc basis. 

Effect 

Tracldng efficiency and cost of service is difficult. 

Cause 

Lack of clear objectives for Financial Services in this area, as stated 
previously, leads naturally to an absence of this functionality. 

Recommendation 

The District should develop a plan for expanding its current system to collect 
infomiation that supports performance measurement and management 
objectives. 
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WUE Strength Finding No. 5 

Related Key Audit Objective: “Reliability of service ’ 



Condition 


As a regional water wholesaler, the District should strive to hold multiple and 
diverse types of water supply sources in its portfolio, and implement steps to 
further diversify its portfolio when appropriate. 

References 

• Board Policy E-2: 2.1.4 


The District is to be commended for its diverse water supply portfolio, and for 
its continuous efforts historically through to the present day to further 
diversify the number and type of its water supply sources. Specifically, the 
District: 

(1) owns and operates multiple local reservoirs and associated facilities for 
groundwater recharge and, when necessary, as alternate sources of supply to 
its water treatment plants; 

(2) imports water from both the State Water Project (SWP) and the Central 
Valley Project (CVP); 

(3) undertakes a comprehensive “water use efficiency” program, which 
incorporates multi-sector water conservation as well as regional partnerships 
in water recycling and desalination; 

(4) conducts imported water banking to maximize its allocations of SWP and 
CVP water; 

(5) is investigating the development of District-owned groundwater wells as 
additional backup to the County municipalities’ wells and the other above- 
mentioned sources; 

(6) is considering reclamation of shallow groundwater, desalination of 
brackish groundwater, and capture of stormwater for water supply purposes. 

These sources are indicated in the WUE Business Plan and water supply 
management and related documents provided for Red Oak’s review. The 
District has developed a thorough Integrated Water Resources Plan, which 
emphasizes the importance of protecting the District’s “baseline” of existing 
sources and the relative low risk and high reliability of local versus imported 
water. The District’s water supply planning takes into account its customers’ 
sources of water (e.g., SFPUC) that the District does not manage. Red Oak’s 
interviews and document reviews confirmed the consistency of this mindset 
and approach throughout the WUE. 
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Cost Accountine 

Although the District has established the basis for cost accounting as 
discussed in the memorandum addressing financial services and develops a 
high-quality annual budget, consistent responses from auditees during this 
audit and Red Oak’s review of WUE’s documentation indicates that cost 
accounting is not used to its full potential at the District. That is, actual 
expenditures are often not tracked against budgeted amounts for projects, 
programs, and operations, and managers/staff are generally not held 
accountable for adhering to budgeted amounts. There are no procedures for 
comparing actual expenditures against budgeted amounts indicated in the 
Water Utility Business Unit procedures or other documents provided for Red 
Oak’s review. This is also evidenced by consistent indication by auditees that 
there is generally no ability to “close” or “inactivate” tasks in the District’s 
timesheet/accounting system, which can be one of the important tools for 
managing actual expenditures on projects underway. This represents an 
opportunity for the District to achieve greater control of costs in the future. 

Cause 

The District has not placed a priority on developing cost-related metrics, 
“operationalizing” its frequently stated objectives regarding providing “cost- 
effective” services to the customers of its WUE, or tracldng actual activities 
and initial scopes and expenditures against budgeted amounts. 

Effect 

For most activities, the WUE and the District cannot readily demonstrate its 
cost-effectiveness to its internal or external stakeholders, or identify its most 
promising areas for cost management. 

Recommendation 

The District should review the budgets and expenditures across the WUE, 
and develop a set of cost-related metrics that capture the major functions and 
cost components of the WUE. This set of metrics should be tracked over 
time to identify positive or negative trends and their causes with respect to 
WUE cost management, and to highlight the most potentially beneficial areas 
for attention to costs. The District should take full advantage of the cost¬ 
accounting infrastructure it has in place, and place a priority on tracking 
actual expenditures against budgets and taking corrective action if and when 
budgets are exceeded. 


WUE Opportunity for Improvement Finding No. 3 

Related Key Audit Objective: “Operational policies and procedures ” 

Criterion j The District should implement a clear policy regarding the use of 

consultants to support its Water Utility Enterprise operations (e.g., in the 
areas of groundwater management, process engineering, water use 
_ efficiency, and/or other areas). This policy should not only address (1) the 
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Effect 


Red Oak was not able to identify any clear adverse effects (e.g., gross non¬ 
performance by a consultant, misuse of consultant budget) due to the lack of 
a specific policy or tracking tools for the use of consultants in the WUE, 
either from verbal information provided by auditees or documents provided 
by the WUE. However, the absence of such a policy provides little 
documentation for District staff to use to respond to questions by Board 
members and external stakeholders regarding the use of consultants 
throughout the District, specifically, regarding the value provided to the 
District, whether the same services could be provided in-house, and whether 
the District is adequately managing the scopes, budgets, and schedules of its 
consultant resources for maximum value to the District. 

Recommendation The District/WUE should develop a clear policy for managers and staff to 
follow to hire and manage consultants (to complement the transactional 
procedures already in place and managed by the Contracts Administration 
Unit). This policy should indicate all the major work areas of the WUE and 
what the District’s policy is regarding using in-house or external resources 
for each. It should enable staff to document why it is necessary to engage 
consultant resources for the task in question, set forth guidelines regarding 
the establishment and tracking of the consultant’s scope, budget, and 
schedule, and help staff set, manage, and document the achievement of 
performance objectives for each consultant engagement. 

This finding is closely related to consultant-oriented findings in the 
Watershed Operations and Capital Program Services audits. 


WUE Opportunity for Improvement Finding No. 4 
Related Key Audit Objectives: N/A 

Criterion The District should have an overall strategic business plan that is responsive 

to the Board’s policy directions regarding its Water Utility Enterprise 
functions. The Water Utility Enterprise should have a strategic business plan 
(and budget) that directly supports the District’s plan. These plans should 
have goals and measurable outcomes associated with the goals, so that 
results can be demonstrated. These goals should include District-specific 
elements as well as goals common to all high-performing organizations (e.g., 
customer satisfaction, employee competency). The District should 
incorporate best strategic planning practices from its high-performing peers. 

Furthermore, the District’s Water Utility Enterprise and Watershed 
Operations groups’ plans and activities should be coordinated and 
complementary, in line with the District’s stated goal to implement 
“comprehensive water resources management” in Santa Clara County. 
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documented as reflective of business need. Since there is no overall plan for 
group membership/participation, staff may not be members of all important 
groups, and it is possible that resources are being expended on participation 
in some non-critical groups. 

Recommendation 

CPS should ensure that its external professional involvement incorporates a 
balance of management (for example, the AWWA/WEF Joint Management 
Conference) and technical aspects of capital project delivery, and ensure that 
both are in alignment with the development needs of staff and CPS. 


Capital Program Services Strength Finding No. 7 

Key Audit Objectives: “Management of the capital program 


Criterion 

CPS should have goals, policies, and procedures in place to demonstrate how 
its project delivery function supports the District’s “Cleaner, Leaner, 
Greener” vision - for example, policies and procedures describing how and 
when “green design” principles, materials, and energy-efficient features are 
incorporated into project planning, design, construction, and operations. 


References: 

o Baldrige Reference: “Value of Visionary Leadership” 

Condition 

The CPS Business Plan and CIP prioritization criteria explicitly link CPS 
activities to the “Cleaner, Leaner, Greener” vision of the District, and to the 
Board’s Ends Policies. 


For example, Theme 1 of the CPS 2006-2007 Business Plan reads, 
“Regarding ‘high-quality innovative projects’—what are the strategies and 
actions CPS should put in place in FY 07 to ensure its products and services, 
i.e. the planning, design and construction of capital projects, are cleaner, 
greener, and leaner?” Throughout the Business Plan the major improvement 
efforts (which are organized by Baldrige category) are each tied to this 
Theme 1 and the District vision. 


Furthermore, the Prioritization Criteria outlined in Appendix A of the 
2006/2007 CIP establishes relative weights to each major aspect of the 
District vision (cleaner, leaner, or greener) and evaluates and ranks the 
projects based on these objectives. For example, the Water Supply Capital 
Projects are evaluated based on meeting CEO interpretations of Board 
Policies. These CEO interpretations are weighted in relation to the vision— 
the primary objective, “Cleaner,” is weighted 50%, and so on for each 
category of capital project. 

Cause 

CPS has emphasized incorporation of the District vision into CPS activities. 
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Section 10 

Baldrige Category 4 - Measurement, Analysis, and Knowledge Management 


measurement, some District objectives set forth in the Board’s Governance Policies are not 
consistent with those presented in the FY 2006 Water Utility Enterprise Business Plan or 
with information provided with Water Utility Enterprise’s lists of internal and external 
customers of each Water Utility Enterprise unit. Additional examples are provided in the 
appended audit memoranda. 

Additionally, it is unclear from the Governance Policies or CEO Scorecard material 
reviewed by Red Oak during the fieldwork for this audit whether or how the measurement 
of many areas of performance “roll up” to any of the District-wide performance measures, 
Ends Policy objectives, or CEO Interpretations, although it is conceptually clear they are 
supporting the Board’s objectives. As noted above, this is an area where the District has 
reported making a number of improvements since the time of Red Oak’s audit fieldwork, 
namely, in the areas of reconciling existing strategic business planning and performance 
measurement efforts and development of a single “CEO Work Plan” and associated 
performance metrics. 

Red Oak recommends that the District continue with, and expedite, its efforts at 
standardizing and reconciling the various performance and customer satisfaction 
measurement systems in place and across the District, with a focus on measuring key 
business processes as opposed to the outputs of organizational units. This will ultimately 
maximize internal “buy-in” and participation in the District-wide performance 
measurement process, and increase the clarity with which the District can demonstrate its 
success to internal and external audiences. Implementation of an established, consolidated 
performance measurement system from year to year will also enable the District to discern 
trends in performance over time and manage accordingly. 
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Section 11 

Baldrige Category 5 - Human Resources Focus 


throughout this report, the development of a single, clear, agency-wide strategic business 
plan would be expected to help significantly in this regard. 

The District’s organizational growth in recent years coupled with strategic business 
planning and staffing decisions being made at the department level and not necessarily at 
the agency-wide level suggest that the historical case-by-case procedure for evaluating 
staffing needs and creating new positions does not provide the District sufficient 
documentation or justification for its existing staffing levels. In other words, this suggests 
that if the organizational growth has taken place due to a clear, programmatic need, such 
as the Clean, Safe Creeks initiative as noted to Red Oak during the finalization of this 
report, this has not been clearly communicated to both internal and external stakeholders, 
and may be contributing to inaccurate perceptions of the District’s management of its 
staffing levels. 

Red Oak understands that the most recent District budget (FY 06-07), which was under 
development during the time of Red Oak’s fieldwork and was finalized just prior to Red 
Oak’s preparation of this report, contains an explanation of the District’s staffing levels 
over time and their relationship to services provided to the community. 

Based on Red Oak’s Administration and Financial Services audit activities, there is a lack 
of an overarching, quantitative cost-control or overhead minimization goal at the District, 
at both the Board/policy level and the CEO/staff level. If one were in place, it would likely 
be a driver for more rigorous examination of staffing levels. Such a cost-control or 
efficiency goal would most effectively be “owned” by Administration, with the Financial 
Services Division supporting the effort with a cost accounting system. 

The District should continue with its efforts to replace or complement its historical case- 
by-case request-based staffing methodology with a more comprehensive effort to align 
human resources with business need across the organization. This should be directly tied 
to the District’s agency-wide strategic business plan. In other words, the District would 
benefit from examining its staffing levels for the entire organization, because it is apparent 
that staffing levels have not historically been correlated with service levels. The District 
would likely also benefit from dialogue to raise awareness among its stakeholders 
regarding its human resource levels and the link between them and District goals and 
activities. Addressing other recommendations in this and other memoranda (e.g., 
addressing potentially redundant or parallel functions in Administration and the operating 
groups) will also contribute to overall efficiency and management of staffing levels. Red 
Oak also understands the District is considering, or already implementing, other actions to 
consider staffing levels agency-wide and build on the analysis it has conducted during its 
last two annual budget cycles. By measuring levels and trends in work system 
performance, the District would also be improving its performance with respect to 
Baldrige Result Area 7.4. 

11.4. Hiring Prioritization 


Closely related to the discussion above regarding staffing levels is the topic of hiring 
prioritization. The District has typically not assigned priorities to its various job 
classifications or positions. There is no formal system to expedite the hiring process for an 
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Recommendation 


the community when making decisions. However, the committees rely 
significantly on the efforts of staff to set the agenda and provide any 
necessary data, though they are attended by and led by Board members. This 
makes the committees susceptible to allowing Board members to exercise 
direct authority over staff. In addition, Board members sometimes require the 
co mmi ttee approval of items before Board approval. 

According to the Policy Governance Model, committees are to be used as 
sources of policy generation rather than just policy and activity review. As 
the committees begin to make the transition from policy review to policy 
generation, there exists a greater opportunity for them to be used by Board 
members as a means to exercise direct authority over staff. Although the 
CEO confirmed the value of the committees and the general lack of 
governance-related problems associated with them now, he does 
acknowledge that Board-driven direction occasionally does occur, and that 
such issues will likely be exacerbated as the roles of committees evolve. 
Several audit team interviews with staff also revealed the Board members do 
at times direct District staff. 


The use of District staff to work on committees headed by Board members 
can lead naturally to the exercise of direction, in contradiction of the 
District’s policy governance model. 


Board members are given opportunity to exercise authority over District 
staff, which is a violation of the District’s policy governance model and 
undermines the effectiveness of the Board-CEO link and the CEO’s 
leadership of the District. 


The Board should set clear boundaries on its use of its community advisory 
committees to ensure they are not used as a means to directly manage 
District staff, and to ensure their use remains consistent with Board policies. 
In addition, the CEO’s interpretation of Board policy regarding direction to 
staff should take into consideration the existing working relationship 
between Board members and District staff on the advisory committees. 


Finding No. 7 - Opportuni 


Criterion 

The Board should have established performance measures by which to gauge 


the effectiveness and efficiency of its policies and activities. 


Reference: 


• Board Policies: BL-3.3 and GP-4 


• Baldrige Measurement, Analysis, and Review of Organizational 


Performance: 4.1b(l) 
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are currently approximately 317 Community Services Districts, 5 Municipal Utility 
Districts, and 23 Municipal Water Districts.) (Maddow) 

• Searched the California Special Districts Association website for information about 
budget approval and oversight of special districts by another government agency. (Red 
Oak) 

® Reviewed the Special District Act and budget approval process for Zone 7 of the 
Alameda Flood Control and Water Conservation District (Zone 7), which is a special 
district similar to SCVWD in terms of water resources managed. (Red Oak) 

• Conversed with Peter Detwiler, a consultant to the Senate Local Government Committee 
with over twenty years of experience with local governance statutes in California, 
including special districts. (Maddow) 

• Conversed with Jess Senecal, an attorney who has been the Chair of the Association of 
California Water Agencies (ACWA) State Legislative Committee for several decades. 
(Maddow) 

• Conversed with Debra Cauble, District Counsel of SCVWD. (Maddow) 

Based on the findings of the above tasks, we have concluded that SCVWD does indeed have a 
unique budget approval process. Although the SCVWD is an independent special district, the 
County still has certain oversight powers for historical reasons. The creation of SCVWD 
involved the 1968 merger of the Santa Clara County Flood Control and Water Conservation 
District, which was a dependent district for which the Board of Supervisors was the legislative 
body, and the Santa Clara Valley Water Conservation District, an independent district with an 
elected board. The statute that made the merger possible provided for the County retaining two 
functions: (1) appointment of at-large members to the SCVWD Board of Directors (two of the 
seven directors) and (2) approval authority over the SCVWD budget. 

To our team’s collective knowledge, only dependent special districts must have their annual 
budget approved by another government agency. For example, Zone 7 of the Alameda Flood 
Control and Water Conservation District is a dependent special district - i.e., a zone within a 
County-wide dependent district. As such, Zone 7 must have its annual budget approved by the 
Alameda County Board of Supervisors, acting for this purpose as the ex officio legislative body 
of Zone 7, despite the existence of Zone 7’s own elected Board of Directors. No other 
independent special districts of which we are aware must have their budget approved by another 
governmental entity. 

Red Oak did not thoroughly research the budget approval process contained in all of the 138 
uncodified special acts under which various unique water and flood control districts and types of 
districts have been organized in California. Doing so would have been outside the scope of this 
particular project, but could be done if further research on this topic is needed. The findings 
presented in this memorandum are based on a necessarily brief review of the 138 uncodified 
special district acts, and on the combined experience of the Red Oak team members and the 
















Cause 

The District is committed to the governance policies of the Board and 
reporting staff progress against those policies regularly to the Board, but is 
still working on standardization of performance management across the 
organization and streamlining the reporting process. 

Effect 

Although the quarterly monitoring reports provided to the Board appear to 
report effectively on the District’s progress against the Board’s policies, they 
require significant, dedicated time on the part of District managers and staff 
to prepare, including information collection, analysis, and reporting. 

Recommendation 

The CEO, working with his Office of Performance Excellence, should 
continue his efforts to consolidate performance metrics across the 
organization. In its development of the District-wide performance 
measurement program, the District should strive for simplicity, and ensure 
that performance measures readily “roll up” to Board-level measures for 
reporting and are directly reflective of the Ends Policies. Certainly, some 
staff effort will be required to prepare regular monitoring reports to the 
Board, but such effort should be limited to assembly and discussion of 
performance measurement results that are already compiled on an ongoing 
basis by the functional groups, as opposed to the equivalent of a special 
stand-alone reporting project for District managers and staff every quarter. 
As indicated above, this topic is addressed in further detail in Attachment A. 

Finding No. 6-0 

pportunity 

Criterion 

The District should strive to be both active and effective in influencing local, 
state, and federal regulations pertaining to its core services. 

Reference: 

0 Baldrige Governance and Social Responsibilities: 1.2c 
o Baldrige Customer and Market Knowledge: 3.1 

Condition 

The District is to be commended for establishing an Office of Government 
Relations, and dedicating staff to various levels of government, including 
maintaining a presence in both Sacramento, California and Washington, 
D.C., using consultants to complement District staff. This office has 
developed a plan that contains a large number of performance metrics. 
However, most of these are “activity-based” as opposed to “results-based.” 
That is, they indicate what governmental relations activities the District plans 
to pursue, but generally do not measure the results of the District’s efforts. 
The exceptions include “Amount of federal appropriations allocated to 
District projects” and “75% of high-priority positions will be supported by 
strategic partners.” There is only limited information available on the 
District’s performance against the metrics it has established for itself. 
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the Board’s policies. This will allow District staff, the Board, and the public to 
readily see the District’s achievement with respect to the Board’s policies. 

As the District continues to integrate and refine its performance measures, we 
recommend that it seek simplicity in the final set of measures and the structure of 
the system. Because of the breadth of services the District performs, there is a 
natural tendency to measure and report on all aspects of the District’s departments 
to the Board and the public. While each work unit needs to measure its 
performance at the appropriate level of detail, reporting work-unit-level details at 
a high level in the organization can result in saddling the District with dozens of 
measures to track, maintain, and evaluate within a complex structure. We 
encourage the District to concentrate on the most important measures that reflect 
the implementation of the vision and strategy of the organization in order to 
facilitate organizational understanding of the process and use of the system. 

3. Weighting of Performance Measures. We recommend that the purpose of the 
weighting (expressed in percentages) of the performance measures on the CEO 
Scorecard be clarified and further explained. While a weighting of measures may 
reflect organizational priorities, it may result in a significantly reduced focus on 
those measures, along with their corresponding activities, that have been assigned 
lower weights - a result the District would not desire. In addition, it opens the 
District up to perhaps an unnecessary level of scrutiny by interested parties 
regarding its values and the relative priorities it places on the measures. All 
measures should somehow reflect the execution of the corporate vision. While the 
weighting system may be the natural tendency of the District, it adds a layer of 
complexity to the performance measurement system, and needs either 
reevaluation or further explanation. 

4. Performance Measures Software. It is likely that the implementation of the 
PB Views software may address the findings presented in this memorandum 
regarding the need to improve the graphical display of the performance measures. 
We recommend that the District ensure that as the system is launched that there is 
a clear understanding and consistent use of color coding, graphic display of 
measure relationships, and roll-up of leading and lagging measures. 

5. Clear Reporting of Performance. As the District improves its reporting of 
performance, it can ensure that the reports include (depending on the audience): 

a. How measures reflect the Board’s End Policies and the District’s 
vision 

b. Clear identification of measure performance, as indicated by color 
coding (green, yellow, and red) 

c. How performance measures are linked (by depicting roll-up of 
measures) 
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Appendix C 


Administration Audit Memorandum 








Red Oak noted a number of strengths and opportunities within Administration not covered by the 
four areas of the key audit objectives (risk management, human resources, information 
management, and real property management). 
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• The 60% compensation guideline considers only salaries and 
the District’s California Public Employee Retirement System (Cal- 
PERS) contribution, and not employees’ benefit packages. This is an 
incomplete representation of employees’ total compensation, is not 
industry-standard, and precludes direct comparisons with similar 
agencies. 

• Not all District positions are routinely analyzed to see 
whether they are within the 60% compensation guideline. The 
District has 30 unclassified positions (14 job titles) for which an 
annual salary study is conducted. Salary studies are regularly 
conducted for a limited number of “benchmark” classified positions. 
The last time a complete classification study was conducted was in 
1999. 

• According to District policy (SCVWD Administrative 
Policies & Procedures, HR Classification Plan & Specifications), the 
District’s compensation is derived from several considerations, 
including internal alignment across District job classifications, labor 
market comparisons, and what can be achieved through collective 
bargaining. District pay is not directly linked to performance or 
achievement of operational, customer, or financial goals, and there 
are no bonus incentives. 

• Red Oak’s analysis of the most recent salary studies 
conducted at various times in 2005 by District HR staff indicate that, 
for all classifications analyzed, the District’s compensation levels 
significantly exceed levels found at other peer agencies. These 
classifications included employees represented by the Mid- 
Management Association (MMA), paralegals, the District’s Risk 
Management Administrator, Board members, 18 classifications 
within the Employees’ Association, and 49 technical and 
administrative classifications. Some of the data suggest action by the 
District in response to earlier studies. For example, District were 
behind their peers in 2002 in terms of compensation (including both 
analyses for base salary, and base salary plus PERS retirement 
benefits), and data provided to Red Oak suggests that the District 
acted on this. Specifically, now MMA employees as a group are 
slightly ahead of their peers, 

® Based on information provided to Red Oak, the District does 
not have an explicit policy or any precedent indicating it ever adjusts 
compensation downwards in response to classification/compensation 
studies. 
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The organization has grown significantly since the last time a 
comprehensive study was performed (1999) - from 636 total 
authorized positions (FY 98/99) to 903 such positions (FY 04/05) - 
underscoring the need for closer attention to evaluating 
classifications and compensation. This relates directly to another 
finding in this memorandum regarding the District’s process for 
establishing human resource needs more closely in alignment with 
its business needs agency-wide. 


The District should establish a systematic classification and 
compensation program that includes (1) conducting studies at the 
appropriate frequency (e.g., every 2 years) and (2) analyses of all 
benefits as well as salary, so the District can accurately represent 
employees’ total compensation and readily compare itself with peer 
organizations. 

Additionally, the District should either include private-sector 
employers as benchmark partners for its classification studies, or 
revise its stated policy accordingly. Red Oak recognizes the inherent 
difficulties in comparing the public sector to the private sector (e.g., 
comparing PERS retirement benefits to private-sector defined- 
contribution plans). However, the Red Oak team’s experience with 
high-performing public-sector Baldrige applicants and award 
winners indicates that a number of them are currently incorporating 
private-sector comparisons into their classification and 
compensation efforts to some degree. 

Addressing these recommendations should provide the District with 
more comprehensive and defensible information to engage in 
discussions with its customers and stakeholders regarding its 
employee compensation levels. 


Finding No. 18- Opportunity 

Key audit objective: “Management of human resources 


Criterion 

The District should have a systematic process in place to make 
staffing decisions and periodically review its staffing levels District¬ 
wide and make adjustments as necessary, to ensure alignment with 
current and future business needs. 

Condition 

Based on documents provided to Red Oak and consistent verbal 
information from auditees, the District has historically assigned 
staffing levels on a position-by-position basis according to 
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9. Encumbrance Reserve - Analyze carryover policies, procedures, and 
timeliness of liquidating open encumbrances 

10. Capital Projects/Fixed Asset Reserve - Compare the District’s Capital 
Improvement Plan to projected revenues, expenditures, cash flow, and 
funding sources 

vi. Risk management/insurance costs: 

1. Assessment ofpotential risks and adequacy of reserves 

vii. Budget policies and procedures 

viii. Effectiveness and efficiency of the District’s organizational structure for 

financial decision-making, planning, and management: 

1. Assessment of existing structure and comparison with best practices 
and relevant benchmarks 

2. Assessment of the District's budget process and (decentralized) 
management and staff involvement 

ix. Indirect cost management and allocation methods: 

1. Assessment of existing practices and comparison with best practices 
and relevant benchmarks 

x. Verification of Article X1IIB, XIIIC and XIIID, State Constitution - Gann 

Government Appropriations Limit Compliance and Right to Vote on Taxes Act 

- Proposition 218 

xi. Investment policies, procedures, and practices: 

1. Assessment of existing practices and comparison with best practices 
and relevant benchmarks 

xii. Contract and procurement administration: 

1. Assessment of existing practices and comparison with best practices 
and relevant benchmarks 


Please note that the “risk management/insurance costs” portion of the above key audit objectives 
is covered in Red Oak’s accompanying memorandum focusing on Administration. 

In general, the fieldwork for the audit of the District’s management of financial resources 
consisted of the following activities: 

a Review of District planning documents, policies, CEO interpretations, internal procedural 
manuals, audit reports, and consultant reports as these relate to financial management 
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District officials regarding the primary financial issues confronting them. 
However, absence of a systematic, formal approach is mitigated by use of the 
budget process and document as effective education tools, and the 
organizational location of certain financial and business functions in the 
operating divisions. Audit interviews indicated a general understanding of 
financial matters among non-financial managers that is, in Red Oak’s 
experience, higher than average. 

Effect 

The engagement of line managers in financial decisions could be improved. 

Cause 

Financial Services has not developed a systematic training and outreach 
program to fully integrate line managers into the financial decision-making 
process. 

Recommendation 

Establishment of a CFO reporting directly to the CEO is a critical part of 
developing enough “clout” from the financial management group to develop 
further integration of financial matters into agency-wide decision-making as 
described above, and as is characteristic of high-performing organizations. 
As part of a strategic plan for financial services in the District, the new CFO 
should include a systematic and formal approach to educating and training 
non-financial managers. Use of the budget process as an educational tool and 
the location of selected financial functions in the operating groups should 
continue. 


FINDING 4.1(a) 


Criterion 

GAO Practice 4: Assess the finance organization’s current role in meeting 
mission objectives. 

GAO Practice 4, Key Point 1. The percentage of resources [within the 
finance organization] spent on strategic support activities is used as an 
indicator of how well finance is supporting mission objectives. 

GAO Practice 4, Key Point 2. Benchmarking and customer feedback is 
used to identify performance gaps and best practices. 

The District should exhibit these GAO Practice characteristics. 

Condition 

Management does not currently have a plan for increasing strategic support 
activities in relation to transaction processing and external reporting. There 
are no formal systems of benchmarking and customer feedback. 

Effect 

There is no foundation of credibility for the financial services function based 
on clear objectives, performance measurement, and customer feedback. Line 
managers generally see Financial Services as performing a custodial, 
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accounted for in the long-range planning needs for Watershed 
Operations. 

• A portion of the District’s existing revenue will expire without voter 
approval 

• State law could provide for diversifying funding sources to provide 
sustainable revenue for increasing costs or gaps caused by reduced 
State and Federal funding. 


Effect 

The uncertainty and capacity of current funding is resulting in annual and 
long-term challenges to perform service-delivery activities. 

Recommendation 

The District should continue and expedite its efforts to perform 
comprehensive planning and to determine any long-term funding gaps or for 
Watershed Operations. 

The funding needs should be compared to existing revenue sources to 
identify gaps and the potential for unmet needs. Available funding options 
should be evaluated to determine if additional funding options or 
modifications to existing sources are needed to provide sustainable funding 
for unmet needs. 


Watershed Operations Opportunity for Improvement Finding No. 4 
Key Audit Objectives: "Operational policies and procedures ” 


Criterion 

Implementation of the District’s Water Resources Infrastructure Protection 
Ordinance should be accomplished with continuing efforts to gain ongoing 
support from partnering communities. 

References 

• Baldrige Criteria 4.2. a & 4.2. c 

• Baldrige Criterion 6.2.b.l 

• Board Policy EL- 7. 8 

• Board Policy E-2.2 

Condition 

Factors and activities within Watershed Operations related to this 
opportunity include the following: 

• A Water Resources Protection Collaborative was established to 
support the ordinance development. 

• Municipal support and participation is strong. 

• The need for a new ordinance is understood. 

• The large number of parcels and local communities adjacent to 
District watercourse facilities complicates management and 
enforcement of removing encroachments in the right-of-way and 
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APPENDIX F 



REGDAK 

CONSULTING 


AUDIT MEMORANDUM 


To: Alison Russell, Project Manager, Santa Clara Valley Water District 

Peter Sakai, Contract Manager, Santa Clara Valley Water District 
Larry Wilson, Audit Committee Chair 

From: Todd Anderson, P.E., Water Utility Enterprise Audit Leader 

Tom Am, Project Officer 

Mauricio Zepeda, P.E., Water Utility Enterprise Auditor 
Date: October 11, 2006 

Re: Comprehensive Performance Audit - Audit Memorandum 

Task 3.4 - Water Utility Enterprise 


This memorandum presents Red Oak Consulting’s (Red Oak) findings documenting the results 
of our audit of the Santa Clara Valley Water District’s (District) Water Utility Enterprise (WUE). 
Red Oak performed this audit as a component of its comprehensive Performance Audit of the 
District. This memorandum represents completion of Task 3.4 of Red Oak’s Agreement No. 
A2921A with the District. 

Introduction 

The District contracted with Red Oak to conduct a performance audit of the District. The audit 
fieldwork and this series of memoranda were structured according to the District’s organization, 
using a “top-down” approach beginning with the Board of Directors. Red Oak and the District 
recognized that many audit findings and recommendations would involve one or more 
organizational units. Therefore, these memoranda were initially presented as interim, preliminary 
drafts and remained so until the completion of the audit. Upon completion of all audit fieldwork, 
Red Oak finalized the interim findings/recommendations presented in this and the other draft 
memoranda. Therefore, this memorandum is to be considered as one component of Red Oak’s 
final audit report to the District. 

Objectives, Scope, and Methodology 

Red Oak conducted the Comprehensive Performance Audit according to Generally Accepted 
Government Auditing Standards (GAGAS). As a result, this memorandum was prepared in 
accordance with the GAGAS Reporting Standards for Performance Audits (USGAO, 2003). 
Additionally, per the scope of work, Red Oak’s audit included a review of systems and processes 
for internal controls; examination of documents and records; interviews with staff, customers, 
and stakeholders necessary to evaluate the District’s compliance with applicable laws, 
regulations, and policies; and evaluation of the effectiveness and efficiencies of the District’s 
policies, procedures, and practices for financial, administrative, and operational management, 




9 Demonstrated incorporation of customer feedback into its operations, 
as evidenced by multiple years of annual water retailer survey results 
and documented follow-up activities provided to Red Oak, and 
documented solicitation/incorporation of water conservation 
customer feedback. 

• Used the customer list process to document key intra-WUE 
relationships and coordination, for example, between the Raw Water 
Operations, Operations Planning and Analysis, and Water Quality 
Units regarding operations, utility maintenance staff coordinating 
with their customers to ensure their needs are met, and close 
coordination between raw water operations and treated water 
operations. 

These activities demonstrate that, in general, the WUE engages in 
commendable activities with respect to its customers, consistent with strong 
customer-oriented behavior exhibited by the District’s top-performing 
industry peers. In addition to the major strengths listed, however, there are a 
number of areas for customer-oriented improvement. 

Red Oak’s review of the WUE’s customer lists, policies/procedures, and 
related documents, and Red Oak’s WUE manager interviews indicated that 
individual domestic well owners receive relatively little formalized attention 
as customers of the District, despite the fact that they collectively represent 
one of the two District’s direct WUE ratepayers, the other being treated 
water retailers and municipalities. They are listed as an external customer in 
the Chief Operating Officer’s customer list; however, they are the only 
customer group indicated without a corresponding performance metric. Also, 
the Groundwater Management Unit’s customer lists indicate a large number 
of external customers and activities but do not indicate well owners. Red Oak 
recognizes that the District offers a number of direct services and outreach 
mechanisms to well owners (e.g., free well water nitrate tests, opportunity to 
petition to be excluded from groundwater charge zones, South County fact 
sheets), but well owners do not have the same formal, documented 
recognition at the WUE level as other direct customers. 

Regarding internal customers, water supply management documents 
provided for Red Oak’s review indicated an additional opportunity for 
improvement. Namely, the District’s groundwater sampling manual indicates 
that it is generally preferable to work with external commercial laboratories 
than the District’s in-house laboratory. Customer lists and laboratory quality 
manuals provided to Red Oak, however, indicate that District groundwater 
sampling (as one of the “in-house water quality studies”) is one of the four 
key internal activities supported by the laboratory. It is not unusual for an 
agency to use external laboratory services, and it can be a recommended 
practice in some cases. For example, using external laboratory resources is 
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due to San Francisco Bay metals loading concerns. Provided this does not 
compromise the District’s treated water corrosion inhibition and Lead and 
Copper Rule compliance, this is a commendable move and another example 
of the District being aware of and acting for multiple purposes. 

However, auditee survey responses provided Red Oak with a number of 
instances of internally generated instances of discrepancy between the 
watershed management and water supply functions of the District, although 
these were not possible to substantiate with the set of documentation Red 
Oak was provided. Red Oak also appreciates that certain conflicts or 
compromises are sometimes inevitable. This also relates to the finding in 
Red Oak’s audit memorandum addressing Watershed Operations and the 
opportunity for plans such as the Stream Stewardship Plan to tie in to the 
District’s integrated water resources planning efforts. The District’s in-house 
investigation of its position with respect to long-term water supply 
sustainability also indicates opportunities to further develop the District’s 
functioning with respect to comprehensive water resource management. 

The WUE does a commendable job of networking with its peers to 
incorporate best practices in a wide variety of technical areas; however, Red 
Oak did not find significant evidence that it typically does likewise in the 
areas of long-term/strategic and annual business planning. The District is to 
be commended, however, for the use of scenario planning, a tool in use 
among its highest-performing peers, during the IWRP process. 

The WUE has developed a consistent set of plans for the programs it leads; 
this can provide the foundation for estimating resource requirements for 
each, and incoiporating those into a systematic agency-wide staffing plan, as 
discussed in Red Oak’s audit memorandum for Administration and the main 
body of the final audit report. 

Cause 

The main departments of the District have historically been strong in the 
areas of business planning and budgeting; however, until now, this has been 
performed in the absence of agency-wide cohesion in the form of a District¬ 
wide strategic plan or similar effort to “operationalize” and prioritize the 
District Board’s goals across organizational boundaries. This is evidenced 
by the different formats, levels of specificity, and timeframes of the 
District’s existing strategic and business plans, and the consistency with 
which chiefs and managers report difficulty with discerning District-wide 
priorities. One of the ways in which the District has moved toward a unified 
and comprehensive approach to decision-making within the WUE is the 
model drafted by the Water Supply Sustainability Planning Unit, which 
attempts to establish a single framework for WUE-wide decision-making 
with respect to water supply. 
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management, which is defined in this case as the management system CPS 
prescribes to ensure that its services satisfy customer needs while complying 
with all applicable regulations. As a result of ISO certification, CPS has a 
well-documented Quality Management System (QMS) that outlines all the 
phases and milestones in the capital project delivery process. 

As part of the ISO certification, CPS has scheduled quarterly audits and 
regular audits performed by an external auditing organization. The findings 
from the internal audits are incorporated into the QMS through the 
Corrective and Preventive Action Request (CPAR) process. This process 
ensures that both process-related improvements and project-related 
improvements are officially evaluated and, when appropriate, incorporated 
into CPS’s QMS. 

Each CPAR is assigned a specific “owner;” this owner is required to develop 
a plan to evaluate the CPAR issue and incorporate it into the QMS. CPARs 
are an effective vehicle for identifying and achieving process improvements. 

Cause 

Through the ISO 9000 certification process and the CPAR process, CPS has 
deliberately established processes to enable and document continuous 
improvement. There are specific guidelines for assigning an owner to a 
CPAR and ensuring that the CPAR is addressed in a specific time period, as 
well as a detailed tracking system to ensure the CPAR is fully documented 
and incorporated in the QMS as appropriate. 

Effect 

CPS internal project audits use the CPAR as the audit deliverable to 
automatically incorporate recommendations for process improvement. 
Furthermore, “lessons learned” from individual projects are memorialized in 
CPARs to ensure improvement in the project process. District CPS managers 
unanimously agree that the CPAR process is important and will continue to 
be a major driver for continuous improvement in processes and resulting 
performance. 

Recommendation 

CPS should use the success of the CPAR process as an example of 
developing a response to a business need for continuous improvement that is 
accepted and utilized throughout the CPS organization. 


Capital Program Services Strength Finding No. 3 

Key Audit Objectives: “Management of the capital program ’ 



The District should clearly identify and define CPS’s customers and partners, 
establish methods for communication with them, actively solicit feedback 
from them, and incorporate then- feedback, as appropriate, into its activities 
to support project-specific (and District-wide) goals and objectives. 
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Cause The CIP is the result of the CIP Task Force co mm issioned by the CEO in 

February 2004. The task force identified the need for long-term, continuous 
capital planning. 


Effect 

The District will improve year-to-year planning and operations with a 
comprehensive multi-year CIP in place. In addition, the District will benefit 
from increased efficiency of project delivery and long-term resource 
management. 

Recommendation 

The CIP should be updated annually and be linked with the Skills, 
Knowledge, and Capability Study that is underway in CPS to identify human 
resource needs and build a more comprehensive District management plan. 
This is discussed under Opportunity No. 5 in this audit memorandum. CPS 
should lead a process for ensuring that costs for operations and maintenance 
after construction are accurately forecasted and budgeted. Tracking of 
operations and maintenance costs of completed CIP projects may be 
necessary to compare actual costs vs. original budget costs. 


Capital Program Seiyices Strength Finding No. 5 

Key Audit Objectives: “District quality assurance procedures used to prevent or detect errors 


and omissions in preparing capital project planning and design 
specifications, contracts, and purchasing documents ” 

“Operational policies and procedures ” 


Criterion 

CPS should have a systematic method for incorporating constructability 
reviews from both internal and external industry experts, and operability 
reviews involving the future project “owners”: Water Utility Enterprise, 
Watershed Operations, and Administration. Furthermore, there should be a 
systematic method to incorporate lessons learned and feedback on completed 
projects into future projects. 

o Baldrige Reference: “Organizational Learning; ” “Values " 

Condition 

Internal constructability and operability reviews are completed as part of the 
District’s standard project 30/60/90%-complete reviews described in the 
design phase WBS (W73004). “Lessons learned” are required to be 
documented and shared with CPS staff at the completion of the planning, 
design, and construction phases of each project within the responsibility of 
CPS. However, external industry experts are typically not involved in these 
reviews, largely due to CPS staffs assumption that the benefit would be 
outweighed by the cost/time of procurement, including Board approval for 
this kind of service (typically sole-source procurement). 

Cause 

CPS has realized the benefit of constructability and operability reviews, has 
formalized them through ISO, and has made them a part of the capital project 
delivery process. However, CPS has not altered its procurement/approval 
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projects to allow CPS project managers or the District as a whole to compare 
performance adequately and fairly. 

Effect 

CPS’s individual project managers may carefully oversee their consultants 
on a project-specific basis, but CPS has only limited ability on the whole to 
objectively compare consultant performance across multiple projects, or 
between multiple consultants. 

Recommendation 

CPS should work with the Contract Administration group to standardize its 
consultant review processes and develop metrics to accurately assess 
individual consultant performance on projects and compare their 
performance to that of other consultants. Examples can be readily found, 
especially in the federal government rating requirements under the Federal 
Acquisition Regulation (FAR). CPS’s consultant performance evaluation 
tool need not be an exhaustive discussion of how the consultant executed the 
project, but should prompt project managers to specifically report on each 
consultant’s adherence to scope, budget, and schedule; how well the 
consultant worked with the District to deal with any changes to those three 
fundamental project parameters; and whether the consultant’s final work 
product met or exceeded the District’s expectations. A number of the 
District’s peers are implementing similar systematic methods to evaluate 
consultant performance. Analogous consultant-related findings from the 
Water Utility Enterprise and Watershed Operations audits are presented in 
those audit memoranda. 


Capital Program Sendees Opportunity Finding No. 5 
Key Audit Objectives: “Management of the capital program ‘ 



CPS should ensure that staff responsible for delivering its capital progr am ’s 
projects are competent in performing their current and future project 
assignments. CPS should establish competency criteria for all key job 
functions and activities within CPS, e.g., years of experience, professional 
certifications, education, and demonstrable capabilities in perfor min g 
technical, engineering, and project management work from entry to advanced 
level. CPS should monitor training requirements for its staff, develop 
budgets and schedules to allow sufficient training, and maintain records of 
training and other professional development. These training activities should 
be coordinated with the appropriate District-wide function in Administration 
(e.g., Organizational Development or Human Resources) so that their 
activities are complementary. 

References: 

o Board Policy E-4.2 

o Baldrige Criterion: 5.2.a.l: Employee education and training 


Page 16 of 21 


October 17, 2006 














Condition 

CPS has developed and implemented specific position requirements within 
the umbrella of broad District specifications. For example, CPS has 
implemented the requirement that employees in responsible charge of capital 
projects, i.e., producing plans and specifications for construction, shall be 
registered engineers. Additionally, CPS has developed its “Staff Knowledge, 
Skills, and Capability Model,” and implementation will begin in FY 2006- 
2007. According to this model, CPS’s training needs will be based on 
employees’ current competency level and the expertise needed to implement 
the current and future capital projects identified in the District’s five-year 
CIP. These needs will be documented in employees’ Classified Employee 
Performance Plans (CEPP). Implementation of the training will be tracked by 
the CPS business unit. 

Cause 

Job classification descxiptions are developed with the bargaining units and 
define the qualifications for each job title District-wide, so are necessarily 
broad and somewhat generic. As a result, CPS has needed to develop specific 
job requirements to be appended to these broad classifications to meet its 
needs. 

Effect 

Currently, CPS job positions appear to contain adequate CPS-specific 
qualifications for their function to complement their broad District-wide 
definition on a District-wide scale. However, the current situation represents 
a long-term risk for CPS because the specific aspects of its job descriptions 
have been developed on a case-by-case basis and are not yet fully integrated 
into District-wide job descriptions or linked to a long-term human resources 
plan. 

Recommendation 

As indicated in the “Overview of Audited Organization” section of this 
memorandum, a challenge the District (and its peers) faces is that “the 
growth of the industry pool of project-delivery-experienced professionals has 
been flat.” Red Oak encourages CPS to follow through with its commitment 
to work together with the Human Resources Division to implement its 
Knowledge, Skills, and Capability Model described in the “Condition” 
section of this finding. When the CIP is updated annually, it should be linked 
with the Knowledge, Skills, and Capability Model to identify human 
resource needs and build a more comprehensive District management plan, 
as alluded to in Strength No. 4 of this memorandum. 

Capital Program Services Opportunity Finding No. 6 

Key Audit Objectives: “District quality assurance procedures used to prevent or detect errors 
and omissions in preparing capital project planning and design 
specifications, contracts, and purchasing documents ” 

Criterion 

For all major CPS activities, CPS should have measures or benchmarks to 
establish goals for project quality, time, costs, and customer satisfaction. 
Specific metrics should be developed to measure performance against project 
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Dave Hook, Engineering Unit Manager, Infrastructure Planning 
Joan Maher, Unit Manager, Imported Water 

Jeff Micko, Engineering Unit Manager, Operations Planning and Analysis 
Sandy Oblonsky, AOO, Water Utility Operations Division 
Melanie Richardson, AOO, Water Supply Management Division 
Dave Smith, Unit Manager, Utility Maintenance 

Darin Taylor, Senior Project Manager, Water Utility Enterprise Business Unit 

Walt Wadlow, COO, Water Utility Enterprise 

Keith Whitman, DOO, Water Supply Management Division 

Ray Yep, DOO, Water Utility Operations Division 

Alan Zeisbrich, Senior Project Manager, Infrastructure Planning 

Capital Program Services Audit 

Leticia Alvarez, AOO, Technical Services Program 

Emmanuel Aryee, Unit Manager, CADD Services 

Ralph Blair, Unit Manager, Construction Engineering 

Debra Caldon, Unit Manager, Environmental Planning 

Dave Chesterman, DOO, Capital Program Services 

Steve Choy, Unit Manager, Land Surveying &c Mapping 

Martin Gamez, Unit Manager, Capital Program Planning 

Nai Hsueh, COO, Capital Program Services 

Gary Kawaoka, AOO, Water Utility Capital Program 

Liang Lee, Unit Manager, Hydraulic Engineering 

Mike Munson, Unit Manager, Structural Engineering 

Katherine Oven, AOO, Watershed Management Capital Program 

Roberto Pamintuan, Unit Manager, Construction Inspection 

Beth Redmond, Unit Manager, Project Management Support 

David Seanez, Unit Manager, Construction Support 

Karen Uyeda, Unit Manager, Process Engineering 

James Wang, Unit Manager, Hydrologic Engineering 
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Deliverables: 1 preliminary draft and 1 final draft memorandum of findings, delivered 
electronically 


Progress Milestone 3.2.4 ' $6,123 


3.3. Administration Section 

Key Audit Objectives: 

Assess the effectiveness and efficiency (including compliance with applicable laws) of: 

a. Management of the District’s financial resources: 

i. Fiscal policies and procedures, (including evaluation of management 

and accounting controls, and controls on spending) 

ii. Fee and rate setting processes and practices 

Hi. Capital project financing 

iv. Internal service funds 

v. Reserves: 

1. Assess justification and basis for reserves -15 major categories 
of reserves and approximately 58 separate reserves in 10 funds 

2. Review of policies and procedures for the creation and use of 
reserves and compare with prevailing practices in existence at 
other water districts 

3. Verification that reserve balances are consistent with policies (as 
of year ended FY 2003-04 and year to date) 

4. Determine if use of reserves is consistent with purposes (FY 
2003-04 and FY 2004-05 year to date) 

5. Working Capital Reserve - analyze District cashflow by fund (36 
month period) 

6. Self Insurance Reserve - Review actuarial reports for liability 
and workers compensation 
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• Review records and library maintenance processes 

• Review communication methodology 

• Review existing performance measures and targets 

• Review the cost-competitiveness of the District’s provision of 
administrative services 

• Execute other specific audit tasks and draft findings for each. 

• Review findings in field with those directly involved, if possible, 
and document feedback 



3.3.1.5 Prepare memorandum of findings 

• Prepare draft for internal team review 

• Revise and review with appropriate client representatives 
(validation meeting) 

• Finalize memorandum of findings 

Task 3.3.1 Assumptions 

Meetings: 1 total (1 validation meeting) 

Interviews: 4 individual interviews 
Deliverables: 1 preliminary draft and 1 final draft 
memorandum of findings, delivered electronically 



3.3.2 Financial Services 

3.3.2.1 Develop plan and schedule for background research 

3.3.2.2 Conduct background research 

• Review documents, including business planning (goals, objectives, 
approaches, action plans, etc), policies and procedures, workload 
and performance statistics, and organizational “charter” 

• Interview Deputy Administrative Officer 

3.3.2.3 Develop audit approach 

• Identify potential audit criteria, including, Carver model, Baldrige 
criteria, District ordinances, Board governance policies, GFOA 
budget principles, GASB standards, and standards adopted by 
similar-sized California water districts 
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Section 3 

Project Goal, Scope, and Methodology 


audit’s recommendations. It is likely that Baldrige Champions will be responsible for a 
particular Baldrige category (e.g., Human Resources Focus) and be tasked with 
championing the recommendations from this audit that best fit within that designation. 

3.3. Key Audit Objectives and Criteria 


The District’s key objectives for this audit were provided to Red Oak in the scope of work 
and guided Red Oak’s audit preparation, fieldwork, and reporting throughout the project. 
These objectives are indicated in the appended scope of work and were also included in 
the appended interim audit memoranda as appropriate to each audit area. 

In accordance with GAGAS, Red Oak established audit criteria for the functions and work 
processes throughout the District, generally based on the following sources. Sources 
specific to each audit area are presented in the corresponding audit memoranda appended 
to this report. 

® The District’s audit objectives as included in the scope of work. 

• The Governance Policies of the District’s Board of Directors. 

• Baldrige National Quality Program criteria. 

• The Red Oak team’s collective experience with governance, management, 
planning, and execution at water districts and analogous organizations. 

® Other discipline-specific standards, as appropriate, as listed in individual findings 
in the memoranda appended to this report and in the References section of this 
report. 


3.4. Audit Fieldwork 


The fieldwork for this performance audit generally consisted of the following components 
(the specific fieldwork components for each of the seven individual audits summarized in 
this report are indicated in then respective interim audit memoranda): 

• Document reviews. 

• Individual interviews with respective Chief and Deputy Administrative or 
Operating Officers. 

® Individual interviews with selected Unit Managers. 

® Group interviews with selected Unit Managers where appropriate. 

• Questionnaires completed by Officers, unit managers, and other key staff as 
appropriate. 

• Follow-up telephone conversations with auditees to confirm facts or inquire about 
additional available information as necessary. 


■ ntRi \K Santa Clara Valley Water District 

CONSULTING Comprehensive Performance Audit Final Report 
... March 2007-3667010 
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Attachment - June 18, 2005 “Special District Budget Approval Process Research” 
memorandum 
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APPENDIX A 



REGDAK 

CONSULTING 

A DIVISION OP MALCOLM PIBMJt 


ATTACHMENT A 


To: Peter Sakai, Contract Manager, Santa Clara Valley Water District 

From: Pete Talbot, P.E., Project Manager 

Robert Maddow, Bold, Polisner, Maddow, Nelson & Judson 

Date: June 18, 2005 

Re: Special District Budget Approval Process Research 


Per our Performance Audit Scope of Work Task 3.1.2, this memorandum provides a summary of 
our research regarding any other “special districts with elected officials whose budgets are 
approved by another level of government.” “Special districts” are classified as either 
“dependent” or “independent.” Dependent special districts are governed by other existing 
legislative bodies (e.g., the city council or board of supervisors also serves as the district’s board 
for some or all purposes). As a general rule, independent special districts such as the Santa Clara 
Valley Water District (SCVWD) have their own, separate board of directors whose members are 
elected by the district’s own voters. Therefore, the requirements that SCVWD have two directors 
appointed by - and that the District must receive approval of its annual budget by - another 
entity (the Board of Supervisors of Santa Clara County) are atypical for an independent special 
district. 

To attempt to identify any other special districts with this type of budget approval process, and 
thereby to determine whether SCVWD is unique in this regard, the Red Oak Consulting (Red 
Oak) team conducted the following research tasks. These tasks were performed by Red Oak staff 
and Robert Maddow of Bold, Polisner, Maddow, Nelson & Judson (with assistance from his 
staff) as indicated below. 

• Selectively reviewed the “uncodified” acts by which the Legislature has established or 
provided for the establishment of 138 special districts or types of special districts in 
California that manage water resources, all of which can be found in the Appendix of the 
California Water Code. (Uncodified acts are enacted to establish or to provide for 
establishment of special districts in circumstances that the Legislature believes to warrant 
special legislation because a statute of general application would not suffice.) (Maddow) 

• Drew upon our existing knowledge of and/or briefly reviewed several codified acts 
within the California Water Code, including the County Water District Law, the 
Municipal Water District Law, the Municipal Utility District Act, and the Community 
Services District Law, under which many water agencies exist. (The codified acts are 
statutes of general application that can be used in a variety of circumstances; e.g., there 











immediately following Board meetings, keeping them informed about Board 
decisions and Board/CEO interaction. As a result, the executive management 
team members, specifically, the chiefs of the District’s four main 
enterprises/departments (Administration, Watershed Operations, the Water 
Utility Enterprise, and Capital Program Services) are very clear on the 
Board’s governance policy model, Ends Policies, and Executive Limitations. 

Cause 

The District’s CEO and executive staff have embraced the Board’s policy 
governance model, and have put a priority on adhering to it and making the 
most of its use. 

Effect 

There is strong communication between the executive team and the CEO, 
and between the CEO and the Board. Links to the Ends Policies in many 
individual standard operating procedures create links in the minds of staff 
implementing the SOPs, and remind them that their activities are directly 
supporting the Board’s goals. Two examples are the Office of 
Communications’ August 2005 Capital Project Outreach Standard Operating 
Procedures (E-4 and E-4.4), and the Office of the CEO/Board Support’s 
Board Member Request Process (EL-9, EL-9.12). 


Finding No. 2 - Strength 


Criterion 

To maximize the usefulness of the governance model, the District should 
facilitate communication between the Board and the CEO. This also supports 
performance reporting. 

Reference: 

o Board Policies: BL-1, BL-3.3, BL-5.4, EL-9.1, EL-9.2, and EL-9.4 
® Baldrige Governance and Social Responsibilities: 1.2a(l) 

Condition 

The District has established the Office of CEO/Board Support, which is a 
significant asset to the Board members in terms of obtaining information 
from, and communicating with, the CEO. The District is also to be 
commended for its establishment of the Office of Performance Excellence, 
which facilitates the CEO’s communication of the District’s performance to 
the Board. 

Cause 

The District emphasizes the CEO’s responsibility to the Board according to 
the governance policy, and has made CEO/Board communication a priority. 
The CEO has accepted the responsibility of reporting accurate and complete 
District performance and status to the Board. 
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Effect 

Board members have a “go-to” unit within the District to communicate with 


the CEO and request/receive information when necessary. This results in 


efficient receipt of information, and helps makes the Board’s regular 


communication with the District as smooth as possible. 


Finding No. 3 - Strength 


Criterion 

The District’s Counsel should effectively manage the resources the District 
expends for legal services. The District Counsel’s office should provide 
efficient legal services to the Board, the CEO, and the District’s departments. 
Effective delivery of legal services requires clear communication with all 
customers of District legal services, efficient management of the scheduling 
and expenditure of the available resources, and effective organization and 
control of documents and other forms of communication - particularly 
privileged communications. 

Reference: 

o Baldrige Strategy Deployment: 2.2a 

Condition 

The District Counsel’s office seeks to practice “preventive law” in an effort 
to help the District recognize and manage risk in a timely and effective 
manner, and advises the office’s clients within the District accordingly. The 
office has focused on the organization of the office with regard to internal 
workflow, assignment tracking and scheduling, document control, and other 
fundamental tools to facilitate orderly and efficient provision of legal 
services to the rest of the District. 

Cause 

The CEO and District Counsel have focused on optimizing all aspects of the 
provision of legal services to the District. 

Effect 

The District should benefit from the District Counsel’s emphasis on 
preventive law, in terms of resources expended and public image. Preventive 
law is probably the best available tool for insulating the District against the 
threat of having to make excess resource expenditures for legal services, 
because it helps to minimize the likelihood, frequency, and severity of 
disputes. The District will also benefit from improved order and efficiency 
with which the District Counsel’s office carries out its business with the rest 
of the District. Please refer to Finding No. 9 of this memorandum for a 
related finding addressing the mission and reporting responsibility of the 
District Counsel’s office. 

Finding No. 4-0 

pportunity 

Criterion 

The CEO’s interpretations of the Board’s Ends Policies should be clear to all 
executive managers and translated into the day-to-day operations of the 
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1. In some cases, sets of existing performance measures are still in the process of 
being integrated. For example, the Key Performance Indicators for the Watershed 
Management Division and the Clean, Safe Creeks and Natural Flood Protection 
Program of the District appear to have been developed independently and are not 
yet incorporated into the current District-wide scorecard-based performance 
measurement program. The “Tier 1” performance measures, which are the Ends 
policy performance measures as reported in the 2004 CAPE application, are still 
in the process of being integrated into the new CEO Scorecard system. This is an 
expected condition for a large, multi-functional agency with a performance 
measurement system under development. 

2. It is not clear how the Baldrige-related measures, as shown on the CEO 
Scorecard, relate to the District Board’s Ends policies and measures. 

3. The District’s performance management system is currently lacking a complete 
discussion of how the performance measures are used. Specifically, the materials 
do not discuss: 

a. How performance measure results influence decision-making. 

b. Who is responsible for developing action plans and/or improving work 
processes when performance for a particular measure is “yellow” (caution) 
or “red” (performance target not met): the Office of Performance 
Excellence or the work unit(s) involved. A related issue is that the CEO 
Scorecard measures are not readily tied to a District work unit or 
individual position. Thus if a measure needs attention, it may not be clear 
who is responsible. 


4. The District has opportunities to improve its display of performance results to 
optimize their use by executive managers and Board members. Specifically: 

a. The District has not yet developed graphical displays of targets on all its 
measure outputs, and color use for targets and performance is not yet 
consistent among all reporting devices. 

b. The current Ends Quarterly Monitoring Report summary graphic suggests 
“roll-up” or “nesting” of measures where they do not necessarily exist. For 
example, “Percent of HazMat Responses Under Two Hours (E.2.2.2.2)” is 
not a subset of “Linear Feet of Bank Stabilized: Budget vs. Actual 
(E.2.2.2)” but that is the relationship a Board member or casual viewer 
may deduce from the graphic. This is related to Strength #1 noted above; 
specifically, the multi-tiered structure of the Ends measures facilitates roll¬ 
up of detailed measures to more general ones, but the logic and 
organization of the existing measures appears to need review. 


5. The District has an opportunity to include a more thorough discussion in its 
quarterly or other reports regarding why a performance target is met or not met. 
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Programs, Classification and Compensation, Employee Health and Safety, Employee Relations, 
Equal Opportunity Programs, Recruitment and Examination, and Benefits Administration. The 
Human Resources Division’s fundamental services include administration of the District’s equal 
opportunity, employee health and safety, and classification and compensation programs. The 
Division is also responsible for a diverse range of services and programs, including 
administering Memoranda of Understanding (MOU) with employee bargaining units, the 
Interest-Based Bargaining (IBB) Program, labor/management partnerships, the District’s 
ergonomic program, safety inspections and training, workers compensation, and “Green 
Business” and facility environmental compliance. 

General Services Division: The General Services Division contains five units tasked with 
supporting the core functions of the District’s operating groups. These include the Equipment 
Management Unit, the Warehouse Services Unit, the Facilities Management Unit, the 
Procurement and Inventory Management Unit, and the Contract Services Unit. In addition, the 
Real Estate Services Unit and the Wells and Water Production Unit are located in the General 
Services Division, as they also provide key services to support the District’s operating groups’ 
projects and revenue collection. 

4. Audit Criteria and Results 


Findings 

In accordance with GAGAS, Red Oak established audit criteria for the functions and work 
processes within the District’s Administration organization, based on the following sources: 

• The District’s audit objectives as included in the scope of work 

• The Governance Policies of the District’s Board of Directors 

• Malcolm Baldrige National Quality Program criteria, specifically, those pertaining to 
human resources, information management/technology, organizational performance 
measurement, and knowledge management. 

• Our team’s collective experience with the key administrative and other “corporate” 
support functions within water districts and analogous organizations. 

• Other discipline-specific standards, as appropriate, as listed in individual findings below 
and in the References section of this memorandum. 

Red Oak developed findings based on the fieldwork and document review described earlier in 
this memorandum. These findings are presented below according to the GAGAS findings 
structure, and are designated as either “Strengths” (positive findings with relatively minor 
recommendations for continuous improvement/optimization) or “Opportunities for 
Improvement” (findings with more significant associated recommendations for improvement). 

Furthermore, the findings are presented according to whether they are “Administration- wide” 
(work processes or topics that span multiple organizational areas) or are more technical or 
otherwise specific to an individual division or unit within Administration. The District’s key 
audit objectives to which each finding most directly relates are also indicated. Please note that 
not all findings have key audit objectives associated with them (as indicated by “N/A”) because 
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Finding No. 5 - Opportunity 


Key audit objective: N/A 

Criterion 

The District should define, measure, track, analyze, and make 
improvements using performance metrics associated with all its key 
Administration functions. Appropriate metrics help encourage 
performance improvement, effectiveness, efficiency, and appropriate 
levels of internal controls. Such metrics should be focused on the 
effective and efficient provision of services necessary to the 
District’s operations, and not be restricted by organizational unit 
boundaries. 


References: 

• Baldrige - 4.1: Measurement, Analysis, and Review of 
Organizational Performance 

• Baldrige -6.1: Value Creation Processes 

• Baldrige - 6.2: Support Processes and Operational Planning 

Condition 

The District’s Administration units are currently in the process of 
identifying performance metrics for their specific functions and 
processes as part of the District-wide CEO Scorecard Project led by 
the Office of Performance Excellence. The project “Power Users,” 
representatives who lead this effort in their respective units, meet 
once a month with the long-term goal of developing one to five key 
metrics per unit. These metrics are developed largely by each unit 
manager and approved by the appropriate deputy. These 
performance metrics will be incorporated into the District-wide 
CEO Scorecard Project and monitored on an ongoing basis. 


As noted in the audit memoranda regarding the Board of Directors 
and the Chief Executive Offices, the District is to be commended for 
undergoing an agency-wide performance measurement effort with 
the goal of optimizing its work processes. However, the majority of 
the Administration metrics that have been developed and made 
available for Red Oak’s review are focused primarily on work 
products and processes involving only one unit. This is a natural 
outcome of the process by which they are being developed, namely, 
according to organizational units. 


For example, the Mail Center & Reprographics unit’s metric is 
“Percent of products delivered on time as scheduled.” This is clearly 
an appropriate metric related to the unit’s immediate service-level 
goals, but there is not a companion metric that measures the value of 
the unit’s service to the District as a whole. For example, the District 
could measure not only reprographics jobs delivered on time, but 
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high-level support, origin, and purpose is clear to all employees. 


District-wide policies and procedures should be consistent in scope 
and easily and regularly reviewed and/or updated for accuracy. The 
updating process would be facilitated by a centralized coordinator of 
all District-wide policies. 

References: 

• Baldrige — 5.1: Work Systems 

• Baldrige -6.2: Support Processes and Operational Planning 

Condition Within Administration, approximately 90% of the units have 

policies and procedures in place. The District routinely involves its 
three employee bargaining units in the development of draft policies 
and procedures. Obtaining this input during the development phase 
helps promote employee ownership of, and compliance with, 
policies and procedures. 

Auditees indicated that the Administrative Services Division has 
historically been the official “owner” of District-wide policies and 
procedures, and that this responsibility would soon be transferred to 
the Administration Business Management Unit. Although policies 
and procedures exist for nearly all units and ownership of the 
policies and procedures is clear, the District’s process to implement 
the procedures and enforce compliance is unclear. 

In some cases, Administration staff appear to be put in the position 
of interpreting Board policy or CEO interpretations as compared to 
simply following existing rules and fulfilling their professional 
administrative “service provider” support role to the operating 
functions of the District. This is consistent with Red Oak’s audit 
finding as presented in the Board of Directors memorandum that 
there is ambiguity among management staff regarding the CEO’s 
interpretations of Board policy. Furthermore, auditees consistently 
expressed frustration with the ambiguity of many of the policies and 
procedures, particularly noting that many of them have been in 
continual revision for the past several years. 

Two areas of particular concern noted by Red Oak include the 
following, although these types of issues are by nature generally 
undocumented and therefore difficult to substantiate for audit 
purposes: 

• Administration’s provision of contract services to the rest of 
the organization. The contract services personnel are charged 
with implementing the Board’s/CEO’s policies regarding 
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Cause 


Effect 


noted later in this memorandum. From Red Oak’s audit activities, it 
was difficult to determine how wide-ranging the types of 
experiences noted in the above examples are. 


There does not appear to be a District-wide project planning system 
that incorporates all relevant District functions/units (employee 
hours and relevant budget) at the initiation of the project, or at the 
appropriate time as the project progresses. 


Administration staff are often asked to provide resources to projects 
they did not anticipate, leading to stress and frustration. For 
example, Real Estate staff often have to scramble to meet legal 
requirements related to offers, negotiations, and legal action related 
to the District’s projects (e.g., acquisition of residential properties 
along a flood control project alignment). Federal and state law 
require “reasonable” time for an owner to consider an offer and 
emphasize there be no coercion to settle. 


Recent changes in federal regulations require owners to be provided 
with a mini m um of thirty days to consider an offer. Red Oak was 
not presented with any evidence indicating the District has not met 
this requirement, but failure to do so can jeopardize state and federal 
funding for projects. It can also have a negative impact on the public 
image of the District. 


Recommendation 


The District should revisit its project planning process and ensure it 
involves the relevant representatives from all the affected operating 
groups and necessary support functions from Administration. This 
will enable Administration to plan ahead to support large projects 
led by the operating groups. 
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effect is that staff is prepared to manage the existing technology and 
effectively troubleshoot issues. This results in general satisfaction and even 
praise for the IMD’s computer and systems support. 



Finding No. 23 - Opportunity 

Key audit objective: “Information management” 


Criterion 

The District should establish and enforce technology hardware and software 
standards. 


References: 

• Baldrige - 6.2: Support Processes and Operation Planning 

Condition 

The IMD has established some informal hardware and software standards to 
guide purchasing decisions. However, it has not incorporated these standards 
into a single, easily referenced document that applies District-wide. 

Cause 

The IMD has set standards verbally and informally but has not yet compiled 
them into a document for staff reference and use. 

Effect 

Hardware and software standards allow the IMD to engage in bulk 
purchasing agreements, lowering the total cost of software licenses, 
hardware, and maintenance agreements. This allows IMD staff to focus skill 
development on a narrower band of technologies, reducing training costs and 
increasing staff expertise within products. However, these standards have not 
yet been formalized in a standards document. As a result the District may be 
purchasing and maintaining a broader array of technologies than needed. For 
instance, it was noted that the District maintains four different web-servers: 
two versions of BEA WebLogic, Microsoft IIS, and Apache. 

Recommendation 

The District should codify its hardware and software standards in a way that 
is accessible to all District staff, such as an intranet web page. A concerted 
effort should be made to adhere to these standards and eliminate existing 
technologies that do not meet them, where possible. The District should also 
develop an exception process to allow for the purchase of non-standard 
hardware and software in specialized cases. 
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Recommendation 


confidence with their existing system. This is the type of information 
that similar agencies with well-developed Geographic Information 
System (GIS) capability can produce very quickly, following the initial 
data layer and system development. 

Red Oak understands that the District has GIS technology and 
resources in place; however, the state of the property management 
system indicates that GIS has not yet been deployed in all areas of the 
District where it can provide a significant benefit. 

Document Management 

The District’s Real Estate Unit currently uses a hard-copy document 
management system to organize, store, and maintain all files relevant to 
District properties. For the past three years, the Real Estate Unit has 
been putting effort into having the budget allocated for implementation 
of an Electronic Data Management System (EDMS) to aid in 
maintaining necessary documentation that characterizes the District’s 
parcels. The Real Estate Unit is currently looking into using a version 
of the “QUESTYS” program used in the Clerk of the Board’s Office 
and are aware that the CADD Services and Records & Library Units 
are also looking into a similar program. 


The property management and document management programs used 
by the District’s Real Estate Unit have not been updated in conjunction, 
or in parallel, with other District information management 
programs/systems to keep current with industry practices and maximize 
customer service and efficiency. 


Management of real estate at the District is limited by the relative 
inaccessibility of data regarding parcels controlled by the District. The 
lost efficiency indicated by the example above (i.e., many hours of 
professional staff labor to produce an answer to what should be a quick 
question) may represent a significant administrative/overhead cost to 
the District. It also represents a lower level of service to the Real Estate 
Unit’s internal customers than what is currently industry standard. 


The District should expand the capabilities of its current District-wide 
GIS application to aid the Real Estate Unit in creating an updated 
property information management system. Furthermore, District real 
estate files—both public information, like property deeds and private 
information like resident relocation files—should be organized in an 
electronic document management system to improve and control 
accessibility to the documents. 
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Audit Criteria and Findings 

In accordance with GAGAS, Red Oak established audit criteria for the Watershed Operations 
audit based on the following sources: 

® The District’s audit objectives as included in the scope of work and described above. 

• The Governance Policies of the District’s Board of Directors. 

• Malcolm Baldrige National Quality Program criteria, specifically, those pertaining to 
strategic planning; customer and market focus; measurement, analysis, and knowledge 
management; process management; and business results. 

• Our team’s collective experience with floodplain management, flood control, and water 
resource agency management. 

Red Oak developed findings based on the fieldwork and document review described earlier in 
this memorandum. These findings are presented below according to the GAGAS findings 
structure, and are designated as either “Strengths” (positive findings with relatively minor 
recommendations for continuous improvement/optimization) or “Opportunities for 
Improvement” (findings with more significant associated recommendations for improvement). 
The District’s key audit objectives to which each finding most directly relates are also indicated. 
Please note that the findings in this audit memorandum are not presented in any particular order, 
although they are organized according to strengths and opportunities. 

Watershed Operations Strength Finding No. 1 

Key Audit Objectives: “Operational policies and procedures ” 

“Compliance with state andfederal regulations ” 

“Environmental management” 


Criterion 

The District’s Watershed Operations should track its regulatory performance 
and strive to improve that performance over time, consistent with the 
District’s mission, to meet or exceed regulatory requirements. 

References 

• Board Policy E-2: 2.1.1 

• Baldrige Criterion 1.2.b.l 

Condition 

• The Regulatory Compliance Unit maintains the Watershed Permit 
Management System (WPMS), which is an Oracle-structured database 
that tracks reporting requirements (e.g., annual reports and other required 
deliverables) for all regulatory permits under which Watersheds 
Operations’ activities are conducted (for example, permits for stream 
maintenance activities and permits for discharges of stonnwater to 
receiving waters), as well as CEQA mitigation monitoring requirements. 
This includes work conducted by other Divisions that relate to Watershed 
Operations. All regulatory permits are scanned and input into the system. 

• There are currently about 60-70 active District permits in WPMS. The 
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Watershed Operations Opportunity for Improvement Finding No. 3 
Key Audit Objectives: “Compliance with State and Federal regulations ” 
“Cost effectiveness ” 


Criterion 

Available options for funding of watershed operations are utilized as 
authorized by State law to provide sustainable revenue to cover the 
increasing costs to complete the Clean, Safe Creeks... Pro gram, accomplish 
scheduled asset replacement, and implement flood protection and stream 
stewardship programs established as core service delivery needs. 


References 

• Baldrige Criterion 6.2.b.l 

• Board Policy EL- 7. 8 

• Board Policy E-2.2 

Condition 

A portion of current revenue for Watershed Operations will expire without 
voter approval. Specifically, the Special Tax approved by the voters in 2000 
will “sunset” (expire) in 2016 as defined in the Special Tax Resolution. If 
the District desires to obtain subsequent funding in a similar manner, the 
District will need to seek voter approval. District revenue from State and 
Federal revenue sources is reducing and is subject to increasing uncertainty. 
The District’s long-term ability to repair, replace, and maintain existing and 
new facilities may not be sustainable without diversifying and increasing 
funding sources. 


The Fiscal Year 2004-2005 Independent Oversight Report of the Clean, Safe 
Creeks ... Program identifies a significant concern that the recent funding 
shortfalls in the U.S, Army Corps of Engineers and California State Flood 
Control Subventions Program could impact the ability to complete proposed 
projects on schedule. In addition, higher than anticipated land and 
construction costs remain a concern. Red Oak understands that District staff 
and Board members are fully aware of this. 

Cause 

Factors and activities within Watershed Operations related to this 
opportunity include the following: 


• Flooding and environmental awareness have led to the need for 
increasing services and facility improvements. 

• Effective and efficient use of available monies is a priority. 

• Costs for the Clean, Safe Creeks ... Program are increasing at higher 
rates than projected, requiring use of other funds to complete 
projects. 

• Revenue from State and Federal sources is reducing and is subject to 
increasing uncertainty. 

• Costs for the scheduled replacement of existing assets has not been 
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most important topics to the District as a whole. Therefore, these memoranda generally do not 
contain exhaustive assessments of any District work unit or work process. 

Red Oak maintained the focus on the District’s key issues through the systematic audit 
methodology outlined in the scope of work, which included the establishment of performance 
audit criteria per GAGAS and as demonstrated in the Findings section of this memorandum. 
Additionally, in accordance with GAGAS, Red Oak’s project management team and audit 
leaders used their professional judgment to focus the audit on material findings and 
recommendations designed to yield the greatest potential benefit to die District. 

Please note that although there are some cost-related findings presented in this memorandum, the 
majority of Red Oak’s findings in response to the “cost” and “overhead” key audit objectives 
noted above are presented separately in Red Oak’s audit memorandum on the District’s financial 
services functions. 

Overview of Audited Organization 

The District’s WUE executes the water supply portion of the District’s stated mission to provide 
for “a healthy, safe, and enhanced quality of living in Santa Clara County through watershed 
stewardship and comprehensive management of water resources in a practical, cost-effective, 
and environmentally sensitive manner.” The WUE is organized into two divisions: the Water 
Supply Management Division, which includes five units, and the Water Utility Operations 
Division, which includes eight units. The WUE also includes a Water Utility Business 
Management Unit and the District’s Office of Emergency Services reporting directly to the 
COO’s office. The two divisions of the WUE consist of the following units: 

Water Supply Management Division 

• Imported Water 

• Water Supply Sustainability Planning 
® Water Use Efficiency 

• Operations Planning and Analysis 

• Groundwater Management 

Water Utility Operations Division 

• Water Quality 

• Laboratory Services 

® Water Utility Engineering 

• Utility Maintenance 

• Utility Treated Water Operations 
® Water Measurement 

• Utility Raw Water Operations 

• Infrastructure Planning 

The above list of organizational units indicates the wide variety of water supply-related functions 
the District performs, and is reflective of the WUE’s organization at the time of Red Oak’s 
primary audit fieldwork (May-July 2006). The WUE consists of 255 employees (current as of 
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Condition 


customers. The District should be incorporating best practices from other 
leading water resources management agencies with respect to continuously 
improving its activities in this area. 

References 

• Board Policy GP-1: 1.1; 1.2 
@ Board Policy E-2: 2.1 

• Board Policy EL-2: 2.4 

• Baldrige Criterion 4. l.a.2 

• Baldrige Criterion 6.1. a. 6 


The District’s Governance Policies, including the CEO Interpretations, 
contain specific, measurable objectives for the WUE to meet regarding 
water supply reliability. Interviews conducted for this audit and Red Oalc’s 
review of documentation provided by the various units involved with 
reliability aspects of the District’s water supply mission indicate consistency 
of understanding and application of the District’s water supply reliability 
objectives. 

The District is to be commended for its relatively ambitious goals with 
respect to water supply reliability as indicated in its Board Governance 
Policies and CEO Interpretations in place at the time of Red Oak’s 
fieldwork, for example, indicating that the District’s water supply reserves 
should be “sufficient to meet demands in a subsequent repeat of the single 
driest year of record (1977).” The District reliability of service does not 
have a similarly explicit goal, but consistent verbal information from 
auditees and water retailer survey results suggest that the District’s goal is to 
manage its system so that its retail customers do not experience any 
shutdowns due to District activity. At the time of preparation of this report, 
Red Oak was provided with the District’s draft “CEO Work Plan,” which, 
when finalized, may provide additional details and levels of performance - 
ranging from “Unacceptable” to “Superior Performance” regarding both 
supply and service reliability - that will add further clarity and measurability 
to the District’s reliability objectives. 

Red Oak understands that the District serves a wide variety of retail 
customers, for example, some with significant treated water storage built 
into their systems and some without. Although Red Oak was not provided 
with copies of the District’s contracts with its retail customers, auditees 
indicated that such contracts typically do not contain any requirements 
regarding the level of service the retailers provide their customers or storage 
in the retailers’ systems. Such requirements would be in part to provide 
continued water service to consumers in case of a District shutdown for 
system maintenance, emergency repairs, or a seismic event. This is one of 
the drivers for the District’s unwritten reliability objective of experiencing 
no shutdowns that affect its retailers. 
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Effect 

The District is continually improving its overall water supply reliability and 


reducing the relative risk associated with any single source of supply. These 


actions translate directly into reduced risk for its treated water and 


groundwater customers. 


WUE Strength Finding No. 6 

Related Key Audit Objective: “Operational policies and procedures ” 


Criterion 

The District should have clear and adequate written operational procedures 
and protocols documenting the major functions of its Water Utility 
Enterprise, including roles and responsibilities (addressing work involving 
multiple units), and key performance measures. 

References 

® Baldrige Criterion 4.1.a. 1 
• Baldrige Criterion 6.1 (all) 

Condition 

The District is to be commended for its well-developed set of WUE 
procedures covering all the primary areas of its WUE operations, based on 
Red Oak’s review of the set of WUE documents provided for this audit. 
Although verbal information provided by some auditees indicated that some 
procedures were still undocumented, the District, nevertheless, is ahead of 
many of its agency peers in terms of the level of documentation of its 
standard operating procedures. These include both procedures that cover 
more traditionally documented areas such as treatment plant operations, and 
also cover the District’s raw water and other water supply management 
functions. 

Red Oak also found a high degree of consistency between work processes as 
described verbally by auditees and their written counterparts. Additionally, 
the WUE has procedures for coordinating across their own organizational 
boundaries, e.g., the water supply management and water utility operations 
functions within WUE. Within one of these two divisions, coordination is 
also indicated in WUE procedures - for example, treatment plant procedures 
consistently indicate coordination with the laboratory and the Water Quality 
Unit for addressing taste-and-odor events, and the WUE uses source water 
quality characteristics to optimize treatment and cost of treatment, as noted 
in the WUE’s Business Plan. In general, Red Oak found that the WUE’s 
documented policies and procedures were internally consistent, well-linked, 
and consistent with verbal information provided by auditees. 

An important gauge of the ultimate effectiveness of the WUE’s operational 
policies and procedures is the satisfaction of its customers - in this regard, 
the water retailers indicate generally high ratings for the District, and call 
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Watershed Operations, is currently drafting a “Project Transition 
Agreement,” which will specify the status requirement of capital projects at 
the transition point from project delivery to project operation and 
maintenance. This is being done to improve the transition of projects from 
CPS to the District’s operations groups and ultimately improve the District’s 
long-term ownership and maintenance of its facilities. 


Cause 

The steps for project transition from construction contract close-out to the 
point at which operations staff take responsibility for the project have 
historically been unclear. CPS’s Quality Management System (QMS) was 
initially focused on planning, design, and construction phases of capital 
projects, and not necessarily on the full life-cycle of CPS’s delivered 
projects. Through the ISO Corrective and Preventive Action Request 
(CPAR) process, the District identified that its project delivery process was 
not complete, and that a “transition phase” or an “expanded close-out phase” 
should be added to the project delivery process. 

Effect 

In general, CPS staff have a well-documented capital project delivery 
approach and structure to follow when executing their work. However, if the 
project transition step were to remain undefined, project transition from the 
construction phase to the operating phase would remain difficult. 

Recommendation 

CPS should continue to improve project transition from capital to operations 
and maintenance by employing written transition agreements and 
modifications to the Work Breakdown Structure (WBS) for both the design 
phase WBS (W73004) and construction phase WBS (W73006) to assist 
project teams and operations staff in preparing for the operations phase of 
each project. CPS should also incorporate these changes systematically into 
the project delivery process, and orient all project staff accordingly. CPS 
should continue to closely monitor its use of the Watershed Operations-based 
ISO procedures noted above to ensure that environmental planning continues 
to be successfiilly integrated into the District’s project delivery process. 


Capital Program Sendees Strength Finding No. 2 

Key Audit Objectives: “Management of the capital program ” 

“Operational policies and procedures ” 


Criterion 

Process improvement strategies should be documented and systematically 
deployed so that the capital project delivery process is continuously 
improving in a measurable fashion. 

Reference: 

o Baldrige Criterion 6.l.a: Value creation processes 

Condition 

As noted in the previous finding, CPS is certified by ISO in their 9001 group 
of standards. The ISO 9001 family of standards addresses quality 
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process to realize the potential benefit of external constructability and/or 
operability reviews. 


Effect 

The District benefits from the utilization of in-house experts in project 
planning and design, which is commendable and an industry best-practice, 
but is missing the potential benefit of external reviews when appropriate. 

Recommendation 

The District should continue its systematic use of constructability and 
operability reviews. Additionally, CPS should work together with 
Procurement and/or the CEO and Board to streamline the 
approval/procurement process to better facilitate outside project review 
opportunities. This is related to Opportunity No. 1 of this memorandum 
regarding the potential benefits of the District becoming more flexible in 
order to take advantage of current industry capital program management 
practices. 


Capital Program Services Strength Finding No. 6 

Key Audit Objectives: “Management of the capital program 


Criterion 

CPS should have goals, methods, and protocols for coordinating with, and 
participating in, professional groups, societies, and other similar agencies. 
Participation in these groups allows sharing of ideas and best management 
practices with respect to capital project delivery, and enables staff to stay 
current in the water supply, treatment, and transmission and watershed/flood 
control capital project delivery arenas. 


References: 

o Board Policy E-4.1 

o Baldrige Criterion: 4. l.a. 2: Key comparisons to support decision¬ 
making and innovation 

o Baldrige Reference: “Value of management by fact” and “best 
practice benchmarks ” 

Condition 

CPS staff involvement in professional groups is broad (e.g., ASCE, APWA, 
AWWA), which is generally commendable. CPS has historically emphasized 
groups that focus on the technical aspects of capital project delivery over the 
management aspects of their business. 

Cause 

The District and CPS place a strong District-wide emphasis on visibility in 
the industry via professional activity participation. 

Effect 

The main value to the District of membership in such a broad range of 
professional societies is that staff gams industry knowledge and the 
networking benefits of professional society participation, both of which they 
can apply to the successful delivery of the District’s capital projects. 
However, CPS’s staffs participation is not quantified or formally 
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acting in accordance with Generally Accepted Government Auditing Standards and the 
requirements of those standards for competence, professionalism, and objectivity. 

Our review focused on the following documents: 

• The SCC/MAD report on its review of the District’s FY 2005-06 budget, cited above, 
dated July 12, 2005 

• Memorandum from the District to the SCC Board of Supervisors responding to that 
report, dated July 25, 2005 

While we have provided brief summaries of these documents, we assume that the reader of thi s 
memo report has reviewed them and is generally familiar with their content. We also assume a 
basic understanding of the functions and purpose of the District, its overall methods of 
operation and governance, and its internal organizational structure. 

In the course of our review, we drew upon work performed during the performance audit, 
including: 

• Review of District financial documents such as the Capital and Operating Budget and 
the Comprehensive Annual Financial Report 

• Focused interviews with Board members, the CEO and top management, and 
management and staff in the Financial Services Division. 

• Review of long-range planning documents 

• Review of work products supporting the calculation of the District’s rates, fees, and 
overhead allocations 

• Standard operating procedures relating to the budget process and other policy-making 
processes of the CEO and Board 

• Board policies and CEO interpretations 

• The Santa Clara County budget document 

• Other documents and references that we deemed necessary in the circumstances to 
develop an appropriate level of understanding of the District’s financial management 
and policy-making practices 

• Other documents and references that we deemed necessary to develop appropriate 
criteria for the evaluation of the District’s financial management practices 


Summary of the SCC/MAD Report and the District’s Response 

The SCC/MAD report consists of a cover memorandum addressed to the Board of Supervisors 
and a full report. The cover memorandum includes a summary of 18 recommendations and a 
summary table of “Recommended Budget Adjustments.” The report is organized into an 
introduction and six sections: 

1. Reserves 

2. Capital Projects * * 

PATHWAYS TO LASTING SOLUTIONS « c* 
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Fiscal and Budgetary Management Approaches and Policies (Recommendations 4, 8, 9, 14 
& 16). 

The SCC/MAD report recommends that the District: 

• Fund personal services costs in the budget at a level that anticipates savings caused by 
frictional employee turnover. 

• Fully fund a post-employment health care benefits reserve fund and provide for 
professional investment management of the fund. The recommended source of funds is 

“surplus ” reserves. 

• Conduct a comprehensive salary and benefit study. 

• Fund insurance reserves at the expected (best-estimate) level rather than at the current 
conservative level. 

The funding of personal services at a discounted level has a one-time effect, limiting funds 
generated by that decision to application to nonrecurring uses. We believe it is the prerogative 
of the District Board and CEO to determine whether it is in the best interest of the District to 
implement such a policy. The District’s current approach of transferring these savings on a 
retrospective basis into a PERS stabilization account seems reasonable and prudent. 

The District is currently developing a policy regarding the funding of post-employment health 
care benefits. We agree that any “surplus” reserves as determined by the District could be 
used as an initial funding source for such a fund. 

Since executive management is clearly in a self-interested position regarding salary and 
benefits for exempt employees, we concur that periodic market studies should be conducted to 
confirm the reasonableness of pay levels for that group. Compensation for staff represented by 
bargaining units should be determined through a process of fair labor negotiation practices, 
and use information developed in accordance with those principles to establish the District’s 
bargaining position. 

Our review of the District’s risk management practices indicates a high level of expertise and 
practice. The SCC/MAD analysis of actual losses in comparison to reserves, however, 
indicates the need to reevaluate the level of self-insurance reserves. We identified this issue 
during our risk management review and understand that a review of the confidence levels for 
establishing reserves is underway. We also have recommended that a periodic independent 
review of liability claims should be undertaken. 

District Budget and Planning Process (Recommendations 1-3. 5-7, & 10-13). 

The SCC/MAD report recommends that the District: 

• Implement an expedited budget calendar to allow the Board of Supervisions sufficient 
time for appropriate review. 

PATHWAYS TO LASTING SOLUTIONS * 







Task 4.1 Assumptions 
Meetings; l 

Deliverables: 1 draft and 1 final summary memorandum of findings, 
delivered electronically 


Progress Milesione4. 1 .4 


$12,980 


2 Develop Recommendations and Prepare Final A udit Report 

4.2.1 Develop list of lecommendations based on existing performance level and desired 
level of performance as defined by audit criteria and/or Consultant’s knowledge 
of industry and/or other best practices. 

4.2.2 Categorize list of recommendations for practical use by the District (e.g., 
according to high, medium, and low priority and/or according to short-term, 
medium-term, and long-term actions) 


Progress Milestone 4.2.2 


4.2.3 Conduct meeting with Performance Excellence office staff to review 
prioritized/categorized list of recommendations 

4.2.4 Revise recommendations if necessary based on input from Performance 
Excellence office. 


Progress Milestone 4.2.4, 


4.2.5 Prepare draft Summary Audit Report. This report will consist of a summary of 
findings as previously summarized under Task 4.1, the agreed-upon 
prioritized/categorized list of recommendations, and appendices including the 

individual previously finalized department audits and other supporting 
documentation (e.g., documents reviewed, list of interviewees). 

4.2.6 Present draft Summary Audit Report to (1) Audit Committee and (2) Board for 
review (exit conference) 


Progress Milcstone42.6 


$21,243 
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A9 New Task 9 - The Consultant's representative shall meet with the Santa Clara County Grand Jury at the 
request of the District. 

This task is for costs related to a telephone conference call between a representative of Consultant's firm and 
Santa Clara County Civil Grand Jury members, This call was requested by the District. 

Task Deliverables 

The Consultant's representative, Mr. R. Lockridge, at the request of the District, will present information to the 
Santa Clara County Civil Grand Jury relative to the nature of the District's Comprehensive Performance Audit. 
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Section 6 
Scoring of Findings 





Approximate 
Condition at Time 
of Audit Fieldwork 

RECOMMENDATIONS 





Memorandum Number 
and 

Brief Topic of Finding or 

Summary of Recommendation 

Anticipated 

Cost 

Magnitude 

Approximate 

Time 

Commitment 

Anticipated 

Inter-departmental 

Coordination 

Main Baldrige Categories 
Addressed by Finding 


Finding lype 

1 - Largely Unrecognized/ 

Unaddressed 

2 - Recognized 

3 - In Planning/Underway 

4 - Well-developed 

5 - Largely Accomolished 

A - Low 

B - Moderate 

C - High 

A - Up to 6 Mos. 

B - 6 Mos. to One Year 

C - Over One Year 

A - Little to no Coordination 

B - Limited Coordination 

C - Substantial Coordination 

B1 

B2 B3 B4 

B5 

B6 B7 

Admin 1 

Strength 

Established bargaining unit policies and practices 

5 






X 


Admin 2 

Strength 

Strong internal customer understanding 

5 





X 

Admin 3 

Strength 

Continue/expand work unit alternative delivery and outsourcing evaluation 

4 

A 

B 

B 


X 


X X 

Admin 4 

Strength 

Optimize/align organizational structure for service delivery 

4 

A 

B 

B 


X 

X 

X 

Admin 5 

Opportunity 

Focus/align performance metrics with District-wide goals 

2 

A 

B 

B 


X 


X 

Admin 6 

Opportunity 

Clarify interpretation of policies and procedures 

3 

B 

B 

B 



X 

x 

Admin 7 

Opportunity 

Develop and adhere to a strategic business plan aligned with District-wide goals 

3 

A 

B 

C 

X 

X 

Admin 8 

Opportunity 

Make project planning comprehensive 

2 

A 

B 

C 

X 

X 

Admin 9 

Strength 

Appropriate loss assessment and reporting 

5 




X 


Admin 10 

Strength 

Solid claim reserve practices; consider encumbering funds and defining authorities 

4 

A 

A 

B 




X 

Admin 11 

Strength 

Appropriate analysis of claim liabilities 

5 







X 

Admin 12 

Strength 

Accurate, appropriate property insurance limits; consider rotating firms 

4 

B 

A 

B 




X 

Admin 13 

Strength 

Solid approaches to loss potential estimation 

5 







X 

Admin 14 

Opportunity 

Allow flexibility in confidence level setting for liabilities and retained losses 

3 

A 

A 

A 




X 

Admin 15 

Opportunity 

Consider external claim file auditing for validation 

3 

B 

A 

A 


x 

Admin 16 

Opportunity 

Prioritize Health & Safety compliance and organization 

2 

C 

B 

C 

X 


Admin 17 

Opportunity 

Establish more systematic classification and compensation program 

3 

B 

B 

B 

X 


Admin 18 

Opportunity 

Implement comprehensive approach to agency-wide staffing 

2 

_ A 

B 

B 

! 

X 



Admin 19 

Opportunity 

Prioritize vacant positions 

2 

A 

B 

B 

X 


Admin 20 

Strength 

Established policies for use of Information Technology resources 

5 




X 


Admin 21 

Strength 

Up-to-date and managed Information Management Division budget 

5 





X 

Admin 22 

Strength 

Formalized Information Management Division staffing and skills needs assessment 

5 





X 

X 


Admin 23 

Opportunity 

Codify District hardware and software standards 

3 

A 

A 

A 


x 

Admin 24 

Strength 

Well-managed Information Technology operations 

5 





x 

Admin 25 

Strength 

Responsive Information Technology help desk system 

5 





X 

X 

X 

Admin 26 

Strength 

Formalized Information Technology governance 

5 




X 


Admin 27 

Opportunity 

Develop detailed project documentation for Information Technology initiative ranking 

2 

A 

B 

B 

X 


Admin 28 

Opportunity 

Update/improve Information Technology master plan 

3 

B 

B 

B 

X 

X 

Admin 29 

Opportunity 

Formalize Information Technology project management 

2 

A 

B 

B 




X 

Admin 30 

Opportunity 

Implement improved information security system 

3 

C 

C 

A 


X 



Admin 31 

Opportunity 

Automate remaining paper-based processes; refine major system implementation 

3 

B 

C 

C 

X 


Admin 32 

Opportunity 

Integrate core information management applications 

2 

C 

c 

B 

X 


Admin 33 

Opportunity 

Delegate real estate authority 

2 

A 

A 

A 

X 


Admin 34 

Opportunity 

Develop real property disposition policy 

2 

A 

B 

B 

X X 


Admin 35 

Opportunity 

Fully utilize District GIS for real estate property management 

2 

B 

B 

B 

X X 


Admin 36 

Opportunity 

Troubleshoot and streamline procurement process 

3 

B 

B 

B 


x 

Admin 37 

Opportunity 

More closely manage Board Member Request process 

2 

A 

A 

B 

X 

X 



Board 1 

Strength 

Strong Board member communication and teamwork 

5 




X - 


Board 2 

Strength 

High degree of inclusion of stakeholders in Board activities 

5 




X 

X 



Board 3 

Opportunity 

Establish Board financial/reserve policy 

3 

A 

B 

B 

X 

X 

“ 


Board 4 

Opportunity 

Conduct Board and Board member performance assessments 

2 

A 

B 

B 

X 


Board 5 

Opportunity 

Formalize Board member orientation and continuing education 

2 

A 

B 

A 

X 


Board 6 

Opportunity 

Establish/clarify parameters of Board committees 

2 

A 

B 

A 

X 


Board 7 

Opportunity 

Strengthen CEO/District evaluation process 

3 

A 

B 

A 

X 


CPS 1 

Strength 

Well-documented capital project delivery structure 

5 





X 

CPS 2 

Strength 

Formal capital process improvement implementation and documentation 

5 





X 

CPS 3 

Strength 

Clarify customer/partner identification and communication 

4 

A 

B 

B 

X 
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Section 6 
Scoring of Findings 





Approximate 
Condition at Time 
of Audit Fieldwork 

RECOMMENDATIONS 







Memorandum Number 
and 

Brief Topic of Finding or 

Summary of Recommendation 

Anticipated 

Cost 

Magnitude 

Approximate 

Time 

Commitment 

Anticipated 

Inter-departmental 

Coordination 

Main Baldrige Categories 
Addressed by Finding 


rmamg lype 

1 - Largely Unrecognized/ 

Unaddressed 

2 - Recognized 

3 - In Planning/Underway 

4 - Well-developed 

5 - Largely Accomolished 

A - Low 

B - Moderate 

C - High 

A - Up to 6 Mos. 

B - 6 Mos. to One Year 

C - Over One Year 

A - Little to no Coordination 

B - Limited Coordination 

C - Substantial Coordination 

B1 

B2 

B3 

B4 

B5 

B6 B7 

WO 5 

Strength 

Sound management of watercourse operation and maintenance 

5 




! X 

X 

WO 6 

Strength 

Systematic, comprehensive joint-use water stewardship program 

5 





X 

X 




WO 1 

Opportunity 

Define District's role in floodplain management and relationship to local agencies 

2 

B 

C 

C 


X 

X 




WO 2 

Opportunity 

Continue and expedite asset management and costing efforts 

3 

B 

C 

B 

X 

x 

WO 3 

Opportunity 

Address gaps in funding needs for District programs 

3 

B 

C 

C 


X 

WO 4 

Opportunity 

Continue and expedite efforts to review, adopt, and implement Infrastructure Ordinance 

3 

C 

C 

C 

X 

X 

WO 5 

Opportunity 

Prioritize integration and update of hydraulic and hydrologic models 

2 

C 

c 

c 

X 


WO 6 

Opportunity 

Develop coordinated strategy for managing permit-driven monitoring and mitigation costs 

3 

B 

B 

B 

“ 

X 

X 




WUE 1 

Strength 

Strong focus on regulatory compliance; clear roles and responsibilities 

5 




X 


WUE 2 

Strength 

Thorough customer and partner identification and communication 

4 

A 

B 

c 

X 


WUE 3 

Strength 

Incorporation of best practices to ensure reliability 

4 

A 

B 

B 

X 

X 

WUE 4 

Strength 

Well-documented and maintained emergency procedures 

5 




X 

X 


X 

X 


WUE 5 

Strength 

Strong focus on maintaining and increasing diversity of water source portfolio 

5 




X 


WUE 6 

Strength 

Well-documented operational procedures and responsibilities 

5 




X 

X 

WUE 7 

Strength 

Strong continuous improvement ethic and peer best-practice awareness/incorporation 

4 

A 

B 

B 

X 



X 


X 

WUE 1 

Opportunity 

Standardize and reconcile various performance management efforts 

3 

A 

B 

C 

X 


X 

X 



WUE 2 

Opportunity 

Build on existing cost-control efforts with comprehensive cost metrics 

2 

A 

B 

A 


X 

WUE 3 

Opportunity 

Standardize consultant measurement and management 

2 

A 

A 

B 


X 

WUE 4 

Opportunity 

Contribute to integration and alignment of discontinuous strategic planning efforts 

3 

A 

B 

C 


X 


X 


X 

WUE 5 

Opportunity 

Continue with asset management database integration and agency-wide implementation 

3 

B 

B 

B 

X ' 

X 


Acronyms and Abbreviations 

Admin = Administration 
Board = Board of Directors 
CPS = Capital Program Services 
CEO = Chief Executive Officer 
FSD = Financial Services Division 
WO = Watershed Operations 
WUE = Water Utility Enterprise 

B1 = Leadership and Governance Baldrige Category 

B2 = Strategic Planning Baldrige Category 

B3 = Customer and Market Focus Baldrige Category 

B4 = Measurement, Analysis, and Knowledge Management Baldrige Category 

B5 = Pluman Resources Focus Baldrige Category 

B6 = Process Management Baldrige Category 

B7 = Business Results Baldrige Category 


This table is a necessarily simplistic version of the findings presented in the final audit report 
and its seven interim audit memorandum appendices. This was prepared by Red Oak to 
allow the District to consider all the individual audit findings and recommendations together, 
and is most fully understood within the context of the narrative audit report and its 
appendices. The relative condition scores reflect the time of completion of audit fieldwork 
for the respective individual audits, not necessarily the time of writing of this report. 
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11 . 


Baldrige Category 5 - Human Resources 

Focus 


The Baldrige program defines “human resources focus” as “how [an] organization’s work 
systems and [its] employee learning and motivation enable employees to develop and 
utilize their full potential in alignment with [its] overall objectives, strategy and action 
plans. Also [included] is [an] organization’s efforts to build and maintain a work 
environment and employee support climate conductive to performance excellence and to 
personal and organizational growth” 

The discussion below is based primarily on individual audit findings presented in the 
Administration, Watershed Operations, Water Utility Enterprise, and Capital Program 
Services audit memoranda appended to this report. 


11.1. Employee Health and Safety Program 


Recently, a third-party review commissioned by the District highlighted several key areas 
where the District’s Health and Safety (H&S) Program is seriously deficient with respect to 
industry best practices, and at least one area where the District is behind current industry 
standard H&S practice. This document also referenced previous third-party evaluations of 
the District’s Health and Safety functions that noted deficiencies. These facts, combined 
with auditee input, indicated at the time of Red Oak’s audit fieldwork that there was no 
measurable improvement in the program and that the District may continue to be out of 
California Occupational Safety and Health Administration (Cal-OSHA) regulatory 
compliance in at least one area. 

The lack of a robust employee Health and Safety program puts the District at higher risk 
of employee injury and workers’ compensation claims. Furthermore, the fact that time and 
funds have been directed towards less immediate or regulatory/mandatory activities at the 
District (e.g., diversity events, general public/school outreach) while basic compliance 
requirements may not have been met leads to a decline not only in the H&S program, but 
also management’s credibility among District employees. 

Red Oak recommends that the District re-focus on basic compliance in the area of H&S in 
order to maximize the credibility of the program among District staff and ensure the 
health and safety of its workforce. Moreover, the District should quickly establish and 
maintain a Health and Safety program with a consistent organizational structure from 
year to year. This will require a commitment from the CEO, Chief Administrative Officer, 
and/or Deputy Administrative Officer of Human Resources to ensure that hiring of the 
necessary individual(s) is made one of the District’s top priorities. By addressing this area, 
the District will enhance its ability to respond to Baldrige Item 5.3 as it applies to ensuring 
workplace health, safety, and security in a proactive manner. In fact, the Baldrige 
program notes that addressing employee safety is a “requirement,” further underscoring 
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Section 11 

Baldrige Category 5 - Human Resources Focus 


the importance of this area. Furthermore, the District’s position with respect to Baldrige 
Result Item 7.4.a.3 would improve, should the District see a positive impact on employee 
well-being as the result of its actions. 

More details on Red Oak’s finding regarding the District’s Health and Safety function, 
including organizational suggestions, are provided in the Administration audit memo 
appended to this report. 

Between the time of Red Oak’s audit fieldwork and preparation of this report, the District 
informed Red Oak that it has made significant progress in the H&S area. Specifically, the 
District has hired a new H&S manager, who is already underway with District-wide H&S 
program design and development to address the issues noted in this report and in the 
appended Administration audit memorandum. 


11.2. Diversity 


As indicated by the District’s establishment of its Office of Diversity, Ethics, and Inclusion, 
and by consistent auditee input, the District places a high degree of emphasis on the value 
of diversity in its organization. This is to be commended and is a trademark of a forward- 
looking public agency. With respect to the spirit of this Baldrige category focusing on 
human resource practices, however, Red Oak identified a clear opportunity for 
improvement. Red Oak was not able to locate a clear, specific policy regarding how 
diversity is incorporated into District hiring and other personnel decisions, and auditees 
consistently reported the District had an unarticulated diversity goal that appeared to be 
subject to ongoing interpretation. Auditee interviews disclosed frustration among several 
managers with recent hiring practices that prevent timely filling of personnel vacancies in 
their sections. 

This contributes to a sense of confusion among hiring managers at the District and lack of 
transparency regarding implementation of the District’s unstated policy regarding 
diversity. Red Oak’s audit activities indicated that District workforce diversity goals are 
(1) not available in writing to internal or external entities, yet (2) informally expected to 
be achieved by District hiring managers and human resources staff. In any case, this clearly 
indicates a perception that there is a lack of clear policy or direction from the Board 
and/or CEO regarding the agency’s objectives with respect to personnel diversity. Whether 
perception is valid or not, its pervasiveness suggests the need for clarification of Board 
policy in this area. 

Red Oak recommends that the District develop and operationalize specific policies 
regarding its diversity goals. An effective approach to this process would be to conduct a 
focused dialogue at the Board and CEO level, and develop a Board policy and CEO 
interpretation accordingly. 
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14. Personnel 


As noted in earlier sections of this report, Red Oak employed a team approach to this 
audit. The key Red Oak team personnel are listed below, along with their primary roles on 
the project. 

Todd Anderson, P.E. Project Manager; Water Utility Enterprise Audit Leader; 

Administration Audit Coordinator 


Tom Arn 

Donna Bodine, P.E. 
Scott Castelli 

Jim Finnegan 
Marcia Fritz, C.P.A. 
Eileen Goodwin 

David Harris, P.E. 

Steve Hayashi, P.E. 
Mark Hildebrand 

Jennifer Hoyle 

Robert Lockridge 

Debby Lu 
Bob Maddow 

Hy Pomerance, Psy.D. 


Project Officer 

Watershed Operations Auditor 

Administration Auditor (Information Management and 
Technology) 

Administration Auditor (Real Estate) 

Quality Assurance Reviewer (Financial Services) 

Quality Assurance Reviewer (Communications and 
Administration) 

Administration Auditor (Information Management and 
Technology) 

Quality Assurance Reviewer 

Project Management Support; Board of Directors Audit 
Support 

Project Management Support; Watershed Operations and 
Capital Program Services Audit Support 

Board of Directors, Chief Executive Offices, and Financial 
Services Audit Leader; Performance Auditing Methodology 
Expert 

Administration Auditor (Human Resources) 

Quality Assurance Reviewer (Governance, Leadership, and 
Legal) 

Quality Assurance Reviewer (Strategic Planning and 
Organizational Development) 
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guidance to prioritize project implementation and/or funding relative to 
District-wide goals, because such a system is not fully “deployed” (in 
Baldrige terminology). This appears to be particularly true for the District’s 
Capital Projects Services group. Although the executive team is well versed 
in the Board’s policy governance model, the Ends Policies, and the 
Executive Limitations, they are not all equipped to apply this knowledge to 
their management of the District’s functional groups. 


Recommendation The CEO should engage in further dialogue with the Board and his 
Executive Leadership Team regarding the interpretations of the Board’s Ends 
Policies. The resulting interpretations should be clear, fully documented, and 
specific enough so that the executive team is comfortable applying them as 
the links between the Board’s policies and the day-to-day operations of the 
District. 

This set of CEO policy interpretations may take the form of a District-wide 
strategic plan and/or a “CEO Work Plan,” which should form the basis of the 
plans of the District’s main departments. Then, each of the four main 
functional groups should create or revise its Business Plan or equivalent to 
spell out how those CEO interpretations directly translate to the programs, 
projects, and activities of the District. 


Finding No. 5 - Opportuni 
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Red Oak noted two organizational units or placements that were not 
fully clear or were inconsistent with standard industry practice as 
follows: 

• The Environmental Programs Unit is organizationally 
located within Administration , and its functions are largely 
dependent on technical data-driven reporting requiring 
collaboration with engineers and other technical personnel. 
Based on information made available to Red Oak, this unit’s 
mission is to implement the District’s involvement in the 
Sustainable Silicon Valley (SSV) program, which is a 
commendable, forward-thinking effort. However, the 
District’s reasoning for creating a stand-alone unit for the 
implementation of this single initiative instead of performing 
its functions within another unit already responsible for 
Administration- wide or District-wide initiatives (e.g., the 
Administration Business Management Unit) is not clear. 

• The Contract Services Unit is located in the General Services 
Division, even though it is closely tied to the Financial 
Services Division. 

Red Oak did not identify any significant work process problems due 
to these organizational arrangements currently, so no specific 
associated changes are proposed or recommended in this 
memorandum. However, the District may want to periodically 
revisit the organizational placement of these units. Although work 
processes may be working well now, this may be unduly dependent 
on the individuals currently in each function, and the current 
structure may contribute to future problems in the event of employee 
turnover. 

Cause 

The District has examined the current structure of Administration 
and is taking action where organizational arrangements will likely 
improve the delivery of necessary services to the rest of the District 
(e.g., training and OD services to the operating groups). 

Effect 

The organizational adjustments within Administration currently 
envisioned by the District promise to improve the clarity and 
effectiveness with which certain areas within Administration provide 
their services (e.g., OD). 
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Recommendation Policies and procedures are an important internal control. They are 
essential to ensure that the District’s programs achieve consistent 
results, are aligned with the District’s mission and Board policies 
(e.g., Executive Limitations), and safeguard the integrity of its 
programs. 

A recommendation made in the audit memorandum addressing the 
Chief Executive Offices applies directly to this finding as well. 
Specifically, in accordance with the District’s policy governance 
model, the CEO should develop clear and specific interpretations for 
all of the Board’s policies, and identify what entity is responsible for 
enforcement of these policies. The CEO should ensure they are 
communicated to his Executive Leadership Team and/or Division 
managers for dissemination to the unit managers and other line staff 
charged with implementing them on a day-to-day basis. 

This may be achieved by executive decision/action on some 
policies, and as the result of focused dialogue in other areas, at the 
CEO’s discretion. Implementation of policies and procedures has the 
greatest chance of success when the policy is clear and non- 
debatable, when compared to policies that are left to Administration 
and/or operating staff to interpret. 

The Chief Administrative Officer should be charged with the 
responsibility to keep up a current listing of all District-wide 
policies, and should ensure that policies and procedures are 
developed for each administrative function. Policies should be 
specific enough that Administration staff do not have to perform any 
additional interpretation to apply policies to District processes and 
make them clear to their internal customers. The policies and 
procedures should also contain clear enforcement provisions with 
consequences for violating the policies. The District should ensure 
there is a policy and procedures maintenance schedule owned by a 
central unit (e.g., Administrative Services, Administration Business 
Management Unit) so the documents can be easily kept current and 
distributed promptly to the necessary parties when updated. 

A key benefit of establishing clear, objective, specific CEO 
Interpretations for all policies is that the administrative professionals 
can focus on their respective areas of expertise (e.g., information 
technology, human resources) and adding the associated value to the 
organization, instead of spending time interpreting Board/executive 
policy. 

This finding is discussed at the District-wide level in the main body 
of the final audit report. 
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6. Risk Management Findings 


Finding No. 9 - Strength 

Key audit objective: “Risk management/insurance costs ” 


Criterion 

Governmental entities other than public entity risk pools are required to 
report an estimated loss from a claim as an expenditure/expense and as a 
liability if both of the following conditions are met: 

• “Information available before financial statements are issued 
indicates that it is probable that an asset had been impaired or a 
liability had been incurred at the date of the financial statements. 

It is implicit in this condition that it must be probable that one or 
more future events will also occur, confirming the fact of the 
loss,” and 

• “The amount of the loss can be reasonably estimated.” 

References: 

• Board Policy EL- 7: Asset Protection 

® GASB Statement No. 10 

• Baldrige - 1.2: Governance and Social Responsibility 

Condition 

The District is to be commended for its loss valuation and recognition 
methodology. Ultimate estimated values of losses are established in the 
individual claim case through reserve estimates as described below, and 
in the aggregate through actuarial review, also described below. 

Cause 

The Risk Management Administrator (RMA) has worked with the 
various parties involved in the District’s workers’ compensation and 
liability insurance programs, including managers in the Human 
Resources Division and Financial Services Division, and the Chief 
Administrative Officer, to assure appropriate audits of claim files and 
actuarial analysis of the overall program. The RMA works with the 
Finance department to assure proper recognition of the liabilities as 
reported in financial documents. 

Effect 

Within the limitations of mathematical probability and in accordance 
with generally accepted risk management practices, the District has 
enacted an appropriate system to forecast its expenses and liabilities 
arising out of workers’ compensation claims and other losses. 
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Finding No. 24 - Strength 

Key audit objective: “Information management ” 


Criterion 

The District should have staff dedicated to the ongoing operation of the local 
and wide-area networks, internet connections, servers, security appliances, 
desktops, and related hardware. Operations staff should have automated tools 
for hardware/network discovery and inventory, security management, backup 
and archival management, network performance monitoring, and software 
updating/patch management. 

Reference: 

• Baldrige - 6.2: Support Processes and Operation Planning 

Condition 

The IMD maintains the Information Technology Unit, which is dedicated to 
the day-to-day operations of the District’s IT assets. This unit uses a variety 
of automated tools to manage hardware, software, backups, and networks. 

Cause 

The IMD has specifically delegated this ongoing maintenance worldoad to a 
dedicated unit and provided a budget for the acquisition of maintenance 
tools. 

Effect 

The Information Technology Unit has been able to focus its attention as a 
team to maintaining the District’s hardware, software, and network. The use 
of automated tools for such functions as software patching and backups 
reduces the amount of repetitive manual labor, which allows more time for 
more valuable activities. 


Finding No. 25 - Strength 

Key audit objective: “Information management ” 


Criterion 

The District should have staff dedicated to first-level "help-desk" support. 
Support hours should reflect normal business hours for all system users. 
Support staff should use service management tools to record and track user 
support requests. 

References: 

• Baldrige -4.2: Information and Knowledge Management 

• Baldrige — 5.1: Work Systems 

9 Baldrige - 6.2: Support Processes and Operational Planning 

Condition 

The IMD maintains the Information Technology Unit, which provides a help 
desk to the District. This unit uses a tool, Remedy, to track and record 
support requests. The IMD also employs account managers to regularly 
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Finding No. 27 - Opportunity 

Key audit objective: “Information management” 


Criterion 

The District should use a well-defined and formal process for rating/ranking 
proposed IT initiatives and identifying those that best align with its business 
objectives. 


References: 

• Baldrige - 4.2a (4): Information and Knowledge Management 

Condition 

The District’s ISSC meets quarterly, or as needed, to discuss major proposed 
IT initiatives and make IT investment decisions. Minor IT projects are 
discussed and prioritized at a lower level by managers within the IMD. 
However, these decisions are made without the benefit of a formal rating and 
ranking process to determine the appropriate benefits and costs of a given IT 
initiative. In addition, these initiatives are not established as clearly defined 
projects to be closely managed within the IMD’s annual business plan, each 
with an individual budget, schedule, scope, and performance metrics. 
However, the IMD does use a Business Partnership Agreement (BPA) to 
formalize an understanding of IT projects between the IT staff and the 
business units. 


The IMD relies on informal discussions to make project prioritization 
decisions. It is noted that the IMD does solicit input and work with the 
individual business units on their needs, which is a strength of the process. 
This strength is further enhanced by the use of BPAs. 

Cause 

Although the District has dedicated resources to establishing the ISSC and 
BPAs to provide a structure for maldng both major and minor IT investment 
decisions, it has not placed a priority on developing or implementing a 
formal rating and ranking process for such decisions, or managing IT 
initiatives to individual scopes, schedules, and budgets. 

Effect 

The IMD does not gain the benefit of a formal project rating and ranking 
process, which would allow fully objective prioritization of IT projects. 
Formal prioritization would aid in justifying project expenditures and 
reducing risk to the overall IMD budget. Further, project documentation is 
not produced at project inception, such as budgets, resource plans, schedules, 
scopes, and performance metrics. The lack of this detailed information 
reduces the chances of identifying and mitigating risks at the 
conceptualization phase of projects, and increases the chances that budgets 
will be overspent and/or initiative results not achieved. 
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9. Real Estate Management Findings 


Finding No. 33 - Opportunity 

Key audit objectives: “Management of real property owned by the District and physical assets - 
facilities and infrastructure ’’ 


Criterion 

The District’s real estate professionals should have the appropriate 
level of flexibility and discretion concerning negotiations and 
settlements necessary for District capital project implementation. 

i:{ 


References: 

• Baldrige - 5.1: Work Systems 

l -f 

i ; 

1 ' 1 

Condition 

The Real Estate Unit of the District has limited delegations as 
compared to analogous functions at comparable public agencies. 
Although the District needs to acquire properties in rights-of-way of 
its capital projects in a timely manner, the Real Estate Unit Manager 
does not have the authority to make administrative settlements to 
avoid litigation when there are disagreements on property prices. 

gj 

i } 
II 

Cause 

The District has not reviewed and adjusted the level of authority it 
grants to the Real Estate Unit commensurate with the expectations 
of the unit and in order to optimize the necessary pre-project steps 
(e.g., property acquisitions) for its capital projects. 

!. ■ 

1 ■ 

j ;.j 

Effect 

When the District is unable to reach agreement with a property 
owner, the District must commence legal proceedings, which are 
costly and time-consuming, and have significant potential to 
negatively impact the District’s image. This creates extra, perhaps 
unnecessary work for the legal staff and delays projects. 

i.b 

v ■' ( 

y ' 

Recommendation 

The District should grant the Real Estate Unit Manager the authority 
to make property acquisition settlement agreements within a 
reasonable amount above the appraised amount. Above this amount, 
more senior members of the leadership team should participate in 
the negotiation. The criteria can be developed from other agencies, 
such as Caltrans. This will increase the efficiency of capital project 
delivery and reduce unnecessary work for both real estate and legal 
personnel. 

f:i 

[S 

1 j 


The District should explore other areas of delegation that would 
improve the Real Estate Unit’s efficiency and project delivery. 
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If 

exist and develop a plan for filling those gaps. This finding is discussed at 
( the District-wide level in the main body of the final audit report. 


FINDING 11.1(a) 


Criterion 

GAO Practice 11: Build a finance organization that attracts and retains 
talent. 

GAO Practice 11, Key Point 1. Top financial leadership participates in 
the recruitment of new talent. 

GAO Practice 11, Key Point 2. A variety of clear career path 
opportunities are offered and staff development programs are used as a 
means of exposing staff to different career opportunities. 

GAO Practice 11, Key Point 3. Competitive compensation and benefits 
packages are available. 

The District should exhibit these GAO Practice characteristics. 

Condition 

The District has not implemented Key Points 1 and 2 of the criterion; 
classification and compensation issues are covered in Red Oak’s 
Administration audit memorandum. 

Effect 

The District is not realizing the benefits of integrating financial leadership 
into recruitment and career path development. 

Cause 

As noted in other findings, the District has not exhibited strong direction or 
placed a priority on integrating financial considerations at strategic levels in 
the organization, including recruitment and career-path issues. Additionally, 
Human Resources is not proactively involved in these matters. 

Recommendation 

The District should develop a plan for integrating Financial Services into 
recruitment and career-path development in alignment with GAO- 
recommended best practices. 


All findings presented in this memorandum, particularly the recommendations, are to be 
considered as one component of the final audit report prepared by Red Oak. 

Views of Responsible Officials 

“Views of Responsible Officials” are included as a component of the main body of the final audit 
report. 
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Permit is currently being developed for the San Francisco Bay Area. 
Adoption of such a permit (likely within the next few years) could 
change how the District’s stormwater program is regulated and 
implemented. 

Cause 

Capital improvement projects and watercourse maintenance activities 
require the development of mitigation areas that are managed and monitored 
to fulfill permit conditions. 

Effect 

The District is not fully prepared for future permit-driven monitoring and 
mitigation requirements and costs, and may be expending more effort than is 
necessary to satisfy the range of monitoring requirements to which it is 
subject. 

Recommendation 

The District should utilize the staff report completed in 2002 to guide the 
development of a coordinated strategy for managing permit-driven 
monitoring and mitigation costs. The upcoming review of the monitoring 
requirements of the existing stream maintenance pennit should be done in a 
manner to ensure that program effectiveness and efficiencies are maximized 
and costs are controlled. The renewal of the current SCVURPPP Municipal 
Urban Runoff Phase I Stormwater NPDES Permit under which the District 
is a permittee should also be reviewed to ensure duplications are eliminated 
and that monitoring is effective and efficient. 


All findings presented in this memorandum, particularly the recommendations, are to be 
considered as one component of the final audit report prepared by Red Oak. 

Views of Responsible Officials 

“Views of Responsible Officials” are included as a component of the main body of the final audit 
report. 

Nature of Any Privileged or Confidential Information Omitted 

No privileged or confidential information was omitted from this audit memorandum. 

References 

The reference list for this and all audit memoranda is included in the main body of the final audit 
report. 
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appropriate; however, it is not clear whether or how the WUE’s performance 
against its large number of customer metrics is tracked, and how either of 
these relates to the indicators provided to the CEO or Board on the 
organization’s overall performance. 

Another example of an opportunity for increased consistency is the “Water 
Supply Reliability Index,” which appears in most units’ “Business Results” 
section of the FY 2006 WUE Business Plan, each with a different metric. It 
may be the case that each unit/function contributes to the overall reliability 
measure of the District in its own way; however, it is not clear whether the 
District is tracking a large number of reliability indices, or whether there is a 
methodology in place to somehow aggregate the numerous reliability index 
scores in play to report an overall reliability index for the WUE or District as 
a whole, as suggested on the CEO Scorecard provided for Red Oak’s review. 

The District/WUE is to be commended for its tradition of being among 
leading agencies with respect to WUE performance measurement and 
management; it is a “Founding Utility Participant” of AWWA’s “QualServe” 
benchmarking program and auditees report sharing benchmarks with similar 
agencies such as EBMUD and Zone 7 Water Agency. This audit finding 
relates to the District making the most of this expertise in performance 
measurement and management in the WUE by ensuring internal consistency 
and clarity, and subsequent coordination with agency-wide performance 
management efforts. 

Cause 

The District has historically taken a proactive role in many areas of water 
resources management such as those listed above, which is commendable. It 
is likely that many performance objectives and measures have been in place 
within the WUE before any attempt by the District at agency-wide 
performance measurement, in part due to the WUE’s activity in QualServe 
and/or other measurement efforts as noted above. Red Oak also understands 
that most of the performance measures in place throughout WUE and the rest 
of the District were developed independently on a unit-by-unit basis. As 
indicated in Red Oak’s audit memorandum addressing the CEO offices of 
the District, the District is underway with an ambitious effort to standardize, 
simplify, and consolidate performance measurement District-wide. 

Effect 

The District is engaging in a wide variety of activities that fundamentally 
support its water resources management and water supply missions. The 
District has a large number of measures in place at various levels of the 
organization designed to demonstrate its success in this regard. However, in 
the case of the WUE, it appears that only one set of these measures are 
tracked regularly (those in the WUE Business Plan), and it is unclear how 
that set relates to the others, or rolls up to the District-wide performance 
measurement framework, Ends Policies, or CEO Interpretations. 
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recommendations designed to yield the greatest potential benefit to the District. 

Overview of Audited Organization 

CPS conducts many projects in any given year. The number and complexity of projects executed 
by CPS have been steadily increasing in recent years. At the same time, the District and CPS 
have been challenged by many factors, as have the District’s peers. Some of these factors are the 
fact that material costs (e.g., steel, copper, concrete) have been increasing, the rate of growth in 
the industry pool of “project-delivery-experienced professionals” has been flat, and the 
competition for quality construction firms in the water industry has been fierce, thereby raising 
overall costs. 

CPS includes the Watershed Management Capital Program, the Water Utility Capital Program, 
the Technical Services Program, and 12 units as listed below. Staff from the units listed are 
assigned to project teams to plan, design, and construct water supply, flood protection, 
mitigation, environmental enhancement, and buildings and grounds capital projects for CPS’ 
internal “partners,” namely, Water Utility Operations, Watershed Operations, and Administration 
and, ultimately, the District’s external customers. In addition to delivering capital projects, CPS 
is also responsible for the management of the District’s long-term Capital Improvement Program 
(CIP). This discussion is reflective of CPS’s organization at the time of Red Oak’s primary audit 
fieldwork (May-July 2006) and as depicted in the April 2006 organizational chart provided to 
Red Oak. 


• Capital Program Planning Unit 

• Project Management Support Unit 

• Hydraulic Engineering Unit 

• Hydrologic Engineering Unit 

• Process Engineering Unit 

• Structural Engineering Unit 

• Environmental Planning Unit 

• Construction Engineering Unit 

• Construction Inspection Unit 

• Construction Support Unit 

• CADD Services Unit 

• Land Surveying and Mapping Unit 

CPS’s mission is straight-forward: to “plan, design, and construct capital projects.” 

Audit Criteria and Findings 

In accordance with GAGAS, Red Oak established audit criteria for the CPS audit, based on the 
following sources: 

® The District’s audit objectives as included in the scope of work and described above. 

• The Governance Policies of the District’s Board of Directors 
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goals such as percent of projects on budget and schedule, size and number of 
change orders, and other key industry metrics. 

References: 

o Baldrige Criterion 4.1.a.l: Key organizational performance 
measures 

Condition 

CPS’s Quality Management System (QMS) has been ISO 9001:2000 
compliant since 2002 and was recertified in 2005; the ISO process 
establishes the framework for CPS’s performance measurement, namely, to 
measure the effectiveness of its QMS. 

Shortly before the commencement of this audit, CPS’s current Technical 
Services Program was relocated organizationally from the District’s General 
Services Division into CPS. The Technical Services Program had developed 
seven metrics that cover cost of operation and customer satisfaction, among 
others. CPS recognized that these metrics were largely measuring activity 
levels and not necessarily the outcomes of those activities. As a result, CPS, 
in order to comprehensively measure the effectiveness of its QMS, will be 
developing new “outcome” measures consistent with the Baldrige Business 
Results categories to supplement previous performance measures and 
support the integration of the Technical Services Program into CPS. 

In short, CPS has not yet agreed upon or established a comprehensive set of 
metrics to measure or quantitatively demonstrate its performance throughout 
its project delivery phases, but Red Oak understands that this is currently 
underway in coordination with the District-wide performance management 
effort. 

Cause 

CPS has recognized the need to establish goals and performance measures in 
accordance with the District’s vision and the Baldrige criteria; therefore, CPS 
started the process of developing/revising its performance measures as part 
of its FY 2007 business plan efforts. CPS teams organized by Baldrige 
Business Results categories are currently scheduled to integrate CPS’s 
measures into the District-wide CEO dashboard in November 2006. 

Effect 

CPS currently has not established a comprehensive set of metrics to measure 
or demonstrate its performance in most of its key areas. Given the success of 
the ISO program, CPS is well-positioned to complete its current efforts to 
develop useful performance metrics across all its key functions and project 
delivery phases. 

Recommendation 

CPS should use its experience gained in ISO certification to complete its 
current efforts in developing accurate and usable performance metrics across 
all its functions. CPS should begin collecting data from existing projects, 
such as engineering time, schedule attainment, original cost estimates, and 
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operation, based on our extensive experience as rate consultants for water and wastewater 
utilities, indicates that this level of reserve is reasonable. 

SCC/MAD also has questioned the significant degree to which the Water Utility Enterprise has 
been funding capital projects with current cash flow and accumulated reserves. We agree that 
this is a legitimate concern. There is a dialectic in utility management between meeting 
reasonable credit-worthiness goals (rating agencies recommend some degree of equity 
financing of capital projects in order to decrease future fixed costs) and intergenerational 
equity (based on cost responsibility principles—those who benefit from the use of a long-term 
asset should bear their fair share of the cost). The Water Utility Enterprise has recognized that, 
for various reasons, this dialectic has become unbalanced on the cash-funding side, and has 
prepared a long-term financial management plan that meets the following objectives: 

• Draws down existing reserves to reasonable levels by using any surplus to cash-fund 
capital projects, thereby limiting nonrecurring sources of funds to use in funding 
nonrecurring uses of funds 

• Reduces the revenue-bond debt seivice coverage ratio to 2.0 

• Stabilizes the long-term balance of equity/debt financing of capital projects to 
30%/70% 

In our opinion, this approach is reasonable, with a slight conservative bias, and reflects an 
acceptable consistency with industry best practices. 

The Water Utility Enterprise should continue to monitor its rates and overhead costs compared 
to similar utilities to ensure that its financial management plan is producing competitive 
results. 

Adjustment to Operating Revenues and Expenditures. Revenue adjustments were based on 
updated infonnation and were accepted by the District. Net expenditure adjustments were 
immaterial. 

Governance Issues ('Recommendations 15 & 17-18). 

SCC/MAD recommends that the District Board exercise a higher level of budgetary control 
during the fiscal year. Die report points to an example where unneeded capital projects funds 
approved in the budget were transferred on the authority of the CEO to other purposes without 
explicit Board approval. 

The report also expresses concern that the responsibility of the Board of Supervisors for 
review> and approval of the District budget be clarified so that “unnecessary risk” is not 
incurred. SCC/MAD also specifically recommends that the Board of Supervisors annually 
review’ the District’s key planning documents as part of its review and approval of the District 
budget. 
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Chief Administrative Offices 


Lauren Keller, Clerk of the Board 
Olga Martin-Steele, CAO, Administration 

Alison Russell, Program Administrator, Administration Business Management Unit 
Ron Whipp, Risk Management Administrator 

Administrative Services 

Sherry Borgsdorf, DAO, Administrative Services 
Debi Jensen, Unit Manager, Organizational Development Sc Training 
Louisa Mendoza, Unit Manager, Business Support Services 
Lonnie Spin, Unit Manager, Records Sc Library 

Human Resources 

Angelica Cruz, Unit Manager, Recruitment Sc Examination and Benefits 
Administration 

Frank David, Program Manager, Classification and Compensation 

Jordan Mendoza, Unit Manager, Human Resources Environmental Programs 

Cheri Northrup, Unit Manager, Employee Relations 

Jose Peralez, DAO, Human Resources 

Estela Tarano, Unit Manager, Equal Opportunity Programs 

Phil Valenzuela, Unit Manager, Employee Health Sc Safety 

General Services 
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Michael Cresap, Unit Manager, Facilities Management 
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Deanna Forsythe, Unit Manager, Real Estate Services 

Dave Gazave, Unit Manager, Contract Services 

Frank Maitski, DAO, General Services 

Art Taylor, Unit Manager, Equipment Management 

Daryl Williams, Unit Manager, Warehouse Services 

Steve Yum, Unit Manager, Procurement Sc Inventory Management 

Information Management 

Brian Hackett, Unit Manager, Information Systems Solutions 
Seth Johnson, DAO, Information Management 
Bill Knoff, Unit Manager, Information Technology 
Bill Tucker, Unit Manager, GIS Administration 
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No, _ Titie _ 

192 Equal Opportunity Programs Unit Annual Business Plan FY 2005 - 2006 

193 Equipment and Materials Management Unit Budget Adopted FY 06 

194 Equipment Management Policies and Procedures- Fleet Administration 

195 Equipment Management SOPs (10) 

196 Equipment Management Unit Description 

197 Equipment Management Unit Organizational Chart 

198 ES 2002 Memorandum of Understanding 

199 ESU Survey Request/Feedback Survey Results 

200 Ethics, Diversity, and Inclusion Overview and Organizational Chart 

201 Example Compliance Report generated from the Watershed Permit-Management System (WPMS). 

202 Executive Guide - Creating Value through World-class Financial Management 

203 Executive Session on Public Sector Performance Management 

204 Expenditure Processing SOP 

205 Facilities Management Unit Adopted Detail Budget FY 06 

206 Facilities Management Unit Description 

207 Facilities Management Unit Job Descriptions 

208 Facilities Management Unit Organizational Structure and Staffing chart 

209 Facilities Management Unit SOPs (11 documents) 

210 FAQs for the CEO Bulletin 

211 Field Operations Service Requests (3 representative: Saratoga Creek, Guadalupe River, and Madrone 
Channel) 

212 Financial Services Division Mission 

213 Financial Services Division Organizational Charts (4) 

214 Financial Services, Capital and Operating Budget 

215 Financial Services, General Information 

216 Financial Summaries: District Reserve Policy 

217 Fiscal Year 2004 Expenditure Processing memorandum 

218 Fisheries and Aquatic Habitat Collaborative Effort (FAHCE) report 

219 Fitch Ratings: The 12 Habits of Highly Successful Finance Officers 

220 Five-year Draft Capital Improvement Plan 

221 Forms and Graphics- 05/06 Budget 

222 Forms and Graphics- Business Plan 

223 Forms and Graphics- Policies and Procedures 

224 Functional Organizational Chart - Unit 889 

225 FY06 Adopted Budget Office of CEO and CEO Support Operations 

226 General Services DAO FY06 Budget 

227 General Services Division Description 

228 General Services Division Scorecard Development 

229 General Services Division Organizational Chart 

230 GIS Applications documents (4) 

231 Governance Policies of the Board of Directors 

232 Government Auditing Standards - 2003 Revision (GAO-03-673G) 

233 Government Relations Unit Functional Chart 

234 Government Relations Unit Strategic Plan 

235 Governmental Accounting Standards Board (GASB) generally accepted accounting principles applicable to 
government 

236 GASB publications relating to performance measurement and reporting 

237 Grant Reimbursement Procedure Flowchart 

238 Groundwater Management Program Descriptions and Related Information 

239 GSD Scorecard Development, Updated 

240 Guidance on Alternative Evaluation and Selection for Natural Flood Protection Projects, WW75125, and 
appendices 

241 Headcount for All Authorized Positions by Job Class 

242 Health and Safety- FY 2005/06 Annual Business Plan 

243 Health and Safety- FY 2006 Capital and Operating Budget Report 

244 Health and Safety- Measures 

245 Human Resources Division Organizational Charts (2) 

246 Human Resources Division Scorecards (7) 

247 Human Resources draft materials 

248 Human Resources FY 2006 Budget 

249 Hydrologic Data Management Annual Report - Services Provided to and Requested of Coyote and 
Uvas/Llagas Watershed: Fiscal Year 2005 

250 Hydrologic Data Management Reports 

251 IBB Timeline for next MOU negotiations 

252 Imported Water Plans and SOPs 
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staff will conduct themselves in a professional manner and adhere to District policies 
regarding personnel practices (District Administrative Policies and Procedures AD 
2.9.100). 

B. The Consultant will be sensitive to the impact that requests for information or 
documentation have on District staffs ability to carry out their normal duties and 
responsibilities. The District will inform Consultant if any such problems are anticipated. 

C. The Consultant will deliver all work products in a timely mariner. The Board values the 
discovery or raising of significant, systemic, or strategic-level policy issues about how the 
District uses public resources, achieves the Board’s Ends and Executive Limitation 
Policies, or complies with applicable laws and regulations. The quality of issues raised and 
recommendations made is more important than the quantity. In communicating findings 
and recommendations, the Consultant will be concise. 

D. Hold strictly confidential all information and materials provided by the District, or created 
by the Consultant, in performing this Agreement. This information and material will 
remain the property of the District: The Consultant will not use or disclose information 
unless authorized to do so in writing by the District. The Consultant’s obligation to 
maintain the confidentiality of all information obtained from the District or other parties in 
connection with the Consultant’s performance under this Agreement will survive the 
termination of the Agreement. 

E. During the term of this Agreement, the Consultant will not engage in consulting or similar 
activities for any company or entity whose business competes with the interest of the 
District without disclosing such conflict. However, such conflict may provide cause for the 
Consultant or the District to terminate this Agreement. 

The Consultant has designated the following firms as sub-consultants for the audit: 

• Marcia Fritz and Company (Marcia Fritz, CPA) 

o Administrative Services, Financial Services, Information Management, 
Risk Management, Real Estate 

• Apex Strategies (Ellen Goodwin) 

o Board of Directors, Chief Executive Offices 

• Universal Field Services (James Finnegan) 

o Real Estate 

« Ron Rakich and Associates (Ron Rakich) 

o Board of Directors, Risk Management 

• Lux Consulting (Debby Lu) 

o Board of Directors, Chief Executive Offices, Administrative Services, 
Human Resources 

• Aquatus Environmental (Donna Bodine) 

o Watershed Operations, Capital Program Services 

• Bold, Polisner, Maddow, Nelson and Judson (Robert Maddow) 
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1.0 Project Management 

Consultant will perform the following scope of services to accomplish necessary contract, 
project management and administration tasks: 

1.1 Prepare monthly one-page status updates and present at up to four Audit 
Committee meetings during the course of the project as necessary 

1.2 Perform ongoing necessary scope, budget, and schedule development and 
oversight for the Consultant and sub-consultant team 

1.3 Conduct ongoing communication as needed with the District Contract Manager 
(Mr. Peter Sakai) and the District Project Manager (Ms. Olga Martin-Steele) 

Task 1.0 Assumptions 

Meetings: 4 total (assumes 4 monthly meetings) ■ 

Deliverables: 9 brief memo-format status updates 


Progress Milestone f ;0 $50, .110 (to be distributed among all 

0. ; • other progress milestones indicated an 

•. ■*. . A: • . , this scope) _ (■> 


2.0 Audit Planning 

2.1 Preparation and Entrance Conference 

• Develop overall audit plan 

• Develop brief entrance conference presentation 

• Deliver entrance conference to Board of Directors and Ad Hoc 
Audit Committee Members 


Task 2.1 Assumptions 
Meetings: 1 entrance conference 
Deliverables: no written deliverables 



sMilestdnc>2. ! i 



2.2 Initial Data Collection 
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Management of human resources: 


i. Assess policies, procedures, and practices for recruitment, retention, 
safety, and diversity 

c. Information management: 

i. Management of information technology 

ii. Measurement and knowledge management (to be incorporated as a 
theme throughout the audit) 

d. Management of real property owned by the District and physical assets - 
facilities and infrastructure 

3.3.1 Administrative Services 

3.3.1.1 Develop plan and schedule for background research 

3.3.1.2 Conduct background research 

• Review documents, including business planning (goals, objectives, 
approaches, action plans, etc), policies and procedures, workload 
and performance statistics, and organizational “charter” 

• Interview Deputy Administrative Officer 

3.3.1.3 Develop audit appro ach 

• Identify potential audit criteria, including Carver model, Baldrige 
criteria, and internal metrics 

• Select critical criteria for audit 

• Establish appropriate timeframe to be audited 

• Determine how the condition will be measured for comparison to 
criteria and how conclusions will be validated with District 
representatives 

• Prepare audit instruments and detailed work plan 

• Conduct internal and client review, revise 



3.3.1.4 Conduct audit fieldwork/deskwork 

• Conduct 3 additional interviews 

• Review training and development programs 

• Review business support sendees 
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Section 6 
Scoring of Findings 


Memorandum Number 
and 

Finding Type 

Brief Topic of Finding or 

Summary of Recommendation 

Approximate 
Condition at Time 
of Audit Fieldwork 

RECOMMENDATIONS 


ain Baldrige Categories 
Addressed by Finding 

Anticipated 

Cost 

Magnitude 

Approximate 

Time 

Commitment 

Anticipated 

Inter-departmental 

Coordination 

IV 


1 - Largely Unrecognized/ 

Unaddressed 

2 - Recognized 

3 - In Planning/Underway 

4 - Well-developed 

5 - Laraelv AccomDlished 

A - Low 

B - Moderate 

C - High 

A - Up to 6 Mos. 

B - 6 Mos. to One Year 

C - Over One Year 

A - Little to no Coordination 

B - Limited Coordination 

C - Substantial Coordination 

B1 

B2 

B3 

B4 B5 

B6 B7 

CPS 4 

Strength 

Solid capital improvement planning 

5 





X 




CPS 5 

Strength 

Continue constructability and operability reviews; facilitate third-party reviews 

4 

B 

A 

A 

1 -x - - 


CPS 6 

Strength 

Balance/align staff professional development 

4 

B 

B 

B 

— 



X ' 


CPS 7 

Strength 

Clear support of District vision 

5 



---—-“- 

X 


CPS 1 

Opportunity 

Systematically evaluate project delivery options 

2 

B 

B 

B 


X 

CPS 2 

Opportunity 

Clarify roles and responsibilities throughout life of capital projects 

3 

B 

B 

C 

X 


CPS 3 

Opportunity 

Consider value engineering or peer review systematically 

2 

B 

B 

B 


X. 

CPS 4 

Opportunity 

Standardize consultant measurement and management 

2 

A 

A 

B 


X 

CPS 5 

Opportunity 

Link/standardize employee competence, education, and training efforts 

3 

A 

B 

B 

X 


CPS 6 

Opportunity 

Develop aligned, practical project performance metrics 

2 

B 

B 

B 

i 


r- 

X 


CPS 7 

Opportunity 

Systematically track regulatory compliance 

3 

B 

B 

B 

X 

. 

CPS 8 

Opportunity 

Incorporate life-cycle analysis aligned with District-wide asset management 

2 

B 

C 

C 

X 


CEO 1 

Strength 

Clear orientation to policy governance 

5 




X 

. 

CEO 2 

Strength 

District facilitates Board-CEO communication 

5 




X 


CEO 3 

Strength 

District Counsel emphasizes preventive law and efficiency 

5 





X 




CEO 4 

Opportunity 

Clarify and standardize CEO interpretations of Board policies 

3 

B 

B 

B 


X 


X 


CEO 5 

Opportunity 

Consolidate measurement of District performance relative to Ends Policies 

3 

B 

B 

C 




X 


CEO 6 

Opportunity 

Incorporate results-based measures into management of governmental relations 

2 

B 

B 

B 

X 


x - 



CEO 7 

Opportunity 

Formalize agency-wide communications vision/policy 

2 

A 

A 

C 

X 

X 




CEO 8 

Opportunity 

Coordinate/align stakeholder communication 

3 

A 

B 

B 



X 


X 

CEO 9 

Opportunity 

Clarify role of District Counsel and align with agency-wide plan 

3 

A 

B 

B 

X 

X 




CEO 10 

Opportunity 

Ensure/coordinate District Counsel authority over legal services expenditures 

3 

A 

A 

A 

X 

X 

FSD 1.0 (a) 

Opportunity 

Formaiize/complete fiscal policies and procedures 

3 

A 

B 

A 

; 

X 

FSD 1.0 (b) 

Opportunity 

Formalize grant application and cost-sharing program process 

2 

B 

B 

B 

: 

X 

FSD 1.0 (c) 

Strength 

Reasonable and prudent reserves; clarify capital project funding process 

4 

A 

B 

B 

. 

X 

FSD 1.0 (d) 

Strength 

Well-developed budget policies and procedures; consider various improvements 

4 

A 

B 

B 





X 

FSD 1.0 (e) 

Strength 

Annual verification of Gann Act/Prop 218 compliance 

5 




: 

X 

FSD 1.0 (f) 

Strength 

Strong investment policies, procedures, and practices; review index comparison 

4 

A 

B 

B 



; 

— H 

X 

FSD 1.0 (g) 

Opportunity 

Perform metric benchmarking of internal service fund charges for decision-making 

3 

B 

B 

C 





X 

FSD 1.1(a) 

Strength 

Solid basic financial accountability and fiduciary responsibility; clarify CEO interpretations 

4 

A 

B 

A 

■ 

X 

FSD 1.2(a) 

Opportunity 

Strengthen link between financial management and operational performance 

3 

B 

B 

C 

. 

X " 

FSD 2.1(a) 

Opportunity 

Strengthen financial leadership/integration through establishment of CFO position 

2 

C 

B 

B 

X 





FSD 3.1(a) 

Opportunity 

Train non-financial managers; continue out-placement of selected functions 

3 

B 

B 

B 


X 

FSD 4.1(a) 

Opportunity 

Ensure financial participation at strategic level in District 

2 

B 

C 

C 

— 



X ' 


FSD 5.1(a) 

Opportunity 

Establish framework for improving efficiency of day-to-day accounting activities 

2 

B 

B 

A 


X 

FSD 6.1(a) 

Strength 

Review/formalize organization of financial functions 

4 

A 

B 

A 


~ X 




FSD 7.1(a) 

Opportunity 

Enhance support of operating activities with financial information 

2 

A 

B 

C 


X 




FSD 7.2(a) 

Opportunity 

Improve current systems to better link financial and organizational performance 

2 

B 

C 

c 




X 


FSD 8.1(a) 

Opportunity 

Develop objectives for financial/operational link; improve systems accordingly 

3 

A 

C 

B 


X 

FSD 9.0(a) 

Strength 

Clear, appropriate fee and rate-setting process 

5 





X 

FSD 9.0(c) 

Strength 

Provide third-party validation of indirect cost management and allocations 

4 

B 

c 

C 


X 

FSD 10.1(a) 

Strength 

Develop formal plan for financial skills and competencies; align with District-wide effort 

4 

B 

c 

B 

x 


FSD 11.1(a) 

Opportunity 

Integrate financial talent considerations into District-wide attraction and retention efforts 

2 

B 

c 

B 

X 


WO 1 

Strength 

Established processes to ensure District meets or exceeds compliance standards 

5 




X 


WO 2 

Strength 

Strong definition of and communication with customers; some opportunity for strengthening 

4 

A 

B 

C 

X 


WO 3 

Strength 

Well-developed documentation of procedures and responsibilities 

4 

A 

B 

A 

X 

X 

WO 4 

Strength 

Clear assessment of Clean, Safe Creeks program performance 

5 




X 



Kill 
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Section 8 

Baldrige Category 2 - Strategic Planning 


8.4. Strategic Planning Approach 


The District should continue its efforts on its CEO Work Plan or similar agency-wide 
strategic business planning tool and build upon its existing department-specific long-term 
and short-term planning strengths. During this process, the District also has the 
opportunity to revisit existing Board policies and CEO Interpretations and ensure they are 
consistent with each other, cover all the key services of the District, and address the issues 
noted in this “Strategic Planning” and the prior “Leadership” discussion. The 
development of CEO-level plans should be done in conjunction with the Executive 
Leadership Team. Development of the Administration, Water Utility Enterprise, 
Watershed Operations, and Capital Program Services plans should ensure alignment with 
the District-wide plan, namely, that the operating groups’ activities directly support the 
achievement of the entire organization’s objectives. Similarly, Division or Unit plans 
should be aligned and directly support department-level plans and, therefore, indirectly 
support the District-wide plan. This structure also provides an important mechanism to 
help ensure that individual departments or units are planning or are engaged in activities 
that are not directly supportive of District-wide goals or otherwise peripheral to the 
mission of the organization. 

By developing and implementing a District-wide strategic plan, the District could more 
effectively respond to Baldrige Criteria Item 2.1, which pertains to strategic development. 
Such an effort would address the consideration given by the Baldrige model to full 
deployment of District resources. Some key areas that the District should consider 
addressing explicitly in an agency-wide plan include: 

® Customer expectations and “market” changes 

• New partnering opportunities 

• Evolving regulatory environment 

® Technology developments 

® Elements of innovation 

® Efficiency gains 

• Employee development and succession planning 

• Supplier/partner development 

Based on Red Oak’s audit activities, the District would benefit greatly from the 
development and implementation of both long-term (e.g., 10-year) and short-term (e.g., 1- 
3-year) strategic business plans. Additionally, as noted in Section 10 of this report related 
to measurement (Baldrige Category No. 4), the District’s agency-wide performance 
measurement efforts should tie directly to this plan, recognizing that there will be (and 
should be) numerous measures that remain at the department or other more specific level. 
An ideal example of the type of agency-wide goal/measure that would apply across all 
organizational areas would be a District-wide cost control or efficiency goal. 

The District’s active participation in the Baldrige program and networking with other 
industries with continuous-improvement orientations provides an ideal forum for the 
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experts consulted as listed at the beginning of this memorandum and in the following References 
and Information Sources section. 
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communication, June 16. 
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Detwiler, Peter. 2005. Staff Director, California State Senate's Committee on Local Government, 
personal communication, June 16. 

Morse, Barbara. 2005. Senior Management Assistant, Zone 7 Water Agency, personal 
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Orellana, Jon. 2005. Assistant General Manager, Zone 7 Water Agency, personal 
communication, June 16. 
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communication, June 16. 
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The District also strives for continuous improvement, as highlighted by its 2005 Eureka Award 
Application for the California Awards for Performance Excellence Program, which is the State 
of California’s implementation of the Malcolm Baldrige National Quality Program (Baldrige). 
Baldrige details an array of criteria to be met by effective organizations, including sets of criteria 
specific to the topics of governance and leadership. 

Red Oak’s selection of audit criteria for the CEO audit was consistent with Generally Accepted 
Government Auditing Standards (GAGAS), which were applied in concert with our professional 
judgment to identify the most significant criteria and findings for this audit. 

Audit Results 


Findings 

In accordance with GAGAS, Red Oak established audit criteria for the CEO and support offices, 
based on the following sources: 

® The District’s audit objectives as included in the scope of work 
® The Governance Policies of the District’s Board of Directors 

© Malcolm Baldrige National Quality Program criteria, specifically, those pertaining to 
governance and leadership, customer focus, and performance measurement 

© Our team’s collective experience with Chief Executive Officers and analogous utility 
leadership positions (e.g., General Managers) 

Red Oak developed findings based on the fieldwork and document review described earlier in 
this memorandum. These findings are presented below according to the GAGAS findings 
structure, and are designated as either “Strengths” (positive findings with no associated 
recommendation or only minor suggestions for improvement) or “Opportunities for 
Improvement” (findings with significant associated recommendations for improvement). Please 
note that the findings in this audit memorandum are not presented in any particular order, 
although they are organized according to strengths and opportunities. 


Finding No. 1 - Strength 


Criterion 

The CEO should follow the governance model adopted by the Board, and 
ensure that executive managers are also well versed in the model and the 
Board’s Ends Policies and Executive Limitations. 

Reference: 

© Board Policies: EL-3 

© Baldrige Senior Leadership: l.la(l), Lla(3), l.lb(l), and l.lb(2) 

Condition 

The District’s executive team is highly educated on the policy governance 
model. The executive team is highly experienced, dedicated, and supportive 
of the CEO, and receives periodic “refresher” training in the governance 
policy model from the CEO. The CEO regularly briefs his executive team 
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offices, frequently across organizational boundaries. For example, the unit is currently managing 
District-wide initiatives such as the Records Retention Project and the Board’s Comprehensive 
Performance Audit Project, as well as Administration- wide efforts including the CEO Scorecard 
project (for Administration ); and development and management of the FY 2007 Summary 
Budget document and the FY 2007 Administration Business Plan. Unit staff also serve as a 
resource for CEO initiatives, such as the District-wide ISO certification project. 

Risk Management Program Unit: The District’s Risk Management Program unit is responsible 
for supporting the CEO in meeting the requirements of the District’s Executive Limitation No. 7 
concerning preservation of District assets. Overall responsibility of the unit includes purchasing 
property and liability insurance for protection against catastrophic loss, maintaining and 
managing self-insured loss funds for liability and property exposures, and identifying and 
managing risks of loss in those same areas. 

Administrative Services Division: The Administrative Services Division provides District-wide 
support services and programs within the areas of the division’s units: Employee Outreach 
Programs, Organization Development and Training (at the time of Red Oak’s Administration 
fieldwork; discussed further in this memorandum), Business Support Services, Mail and 
Reprographics Services, Receptionist and Word Processing Services, Forms and Graphics 
Services, and Records and Library functions. Ownership and maintenance of the District’s 
administrative policies and procedures is another key function of tire Division. 

Information Management Division: The Information Management Division provides 
information management and technology services to the entire District in four main areas as 
follows: 

The Information Systems Solutions (ISS) unit provides database administration and development 
services, application development services, and Intranet/Internet applications support. The ISS is 
also primarily responsible for the enterprise resource planning (ERP) application, PeopleSoft , 
and the District’s computerized maintenance management system (CMMS), Maximo. 

The Information Technology (IT) unit is responsible for computer network administration, data 
center operations and administration, microcomputer hardware and software installation, two- 
way radio operations, audio/visual systems operations, help-desk support and 
telecommunications services. 

The Information Systems Master Plan (ISMP) Implementation staff provides objectives, 
justification, and plans for improving the District’s use of information systems and information 
infrastructure. 

The Geographic Information Systems (GIS) Administration Unit provides access to the District 
enterprise GIS in the form of electronic media and services, data, software, hardware, and 
training to better serve the District’s customers and provide District employees with the tools to 
accomplish the mission of the organization, 

Human Resources Division: The seven units included in Human Resources are Environmental 
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5. Administration-wide Findings 


Finding No. 1 - Strength 

Key audit objective: “Management of human resources 


Criterion 

The District should have effective and cooperative relations with its 
employee bargaining units, as evidenced by policies and practices 
governing each employee’s relationship with the organization. 

References: 

• Board Policy EL-3 (3.6): Treatment of Staff 

• Baldrige - 5.3: Employee Well-Being and Satisfaction 

Condition 

The District has adopted an Interest-Based Bargaining (IBB) 
approach to build input and inclusion from its three bargaining units 
into decision-making. The District has provided IBB training to 
familiarize District employees on problem-solving skills, 
bargaining, and facilitation, and implements IBB principles in its 
dealings with employee groups. As of December 2005, 500-600 
District employees (60-75%) had been trained in IBB. During 2005, 
one grievance was denied and one is on hold; otherwise all 
grievances have been resolved through agreement and collaborative 
cooperation. Data on the total number and type of grievances were 
not available for Red Oak’s review. Red Oak found consistent 
verbal feedback that the IBB process has led to improved 
employee/management relations at the District, but other than the 
figures above, data was not available to substantiate this. 

Cause 

District management has made improved employee relations a 
priority throughout the District. 

Effect 

Effective relations between management and employee 
organizations contribute to better individual and District 
performance. Obstacles to operational changes are addressed in a 
constructive manner, contractual bargaining is completed more 
expeditiously, and issues can be addressed proactively. As a result, 
both District management and employees are able to spend more 
time on the District’s core functions as opposed to resolving 
grievances or other potential management/employee problems. To 
gain the most benefit from its IBB approach, the District may want 
to consider implementing objective performance metrics (e.g., 
number/percentage of grievances over time, frequency and time-to- 
resolution of grievances and disciplinary matters, average 
nature/severity of staff/management matters over time) to assess the 
performance of IBB and measure the ability of employees and 
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References: 

• Baldrige - 4.2: Information and Knowledge Management 

• Baldrige- 5.1: Work Systems 

• Baldrige - 6.2: Support Processes and Operational Planning 

Condition 

Administration has undergone a number of organizational changes 
in recent years, some of which appear to have combined dissimilar 
functions or made functionality or accountability less clear to 
Administration’s internal customers. The District has published a 
reference booldet of Administration’s units and services for its 
internal customers. The District is to be commended for recognizing 
the adverse effect that some of its organizational changes have had 
on work process clarity and the level of service provided by 
Administration to the rest of the District, and for making positive 
changes to address each. Examples are provided below. 

• At the time of Red Oak’s fieldwork, the District housed its 
Organizational Development (OD) functions within the 
Administrative Services Division (e.g., reprographics, mail). 
The District originally established this structure because it 
seemed that one division manager could oversee both 
functions, so it offered an opportunity to contain costs 
(specifically, reduce the need for one division manager). 

However, the CAO and her staff have found that this 
arrangement is not enabling the Organizational Development 
functions to be fully delivered. As a result, the CAO is 
moving forward with establishment of a separate OD 
function, with clear responsibilities and no overlap with 
existing Human Resources services, and the distribution of 
the remaining Administrative Services functions to other 
divisions within Administration. 

• The Office of Ethics, Diversity, and Inclusion (OEDI) was 
created in 1999 and reported directly to the General 
Manager. Red Oak understands based on documents 
provided by the District that this office was initiated in 
response to Grand Jury recommendations, bargaining unit 
comments, and larger public concerns about ensuring lawful 
and ethical behavior at the District. Red Oak’s opinion 
following our initial audit fieldwork was that although these 
topics are, of course, critical, the unit occupied a high place 
in the District organization relative to other key work areas 
elsewhere in the District. 

The CAO has recognized that the role and organizational 
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also track the percentage of District-wide reprographics projects that 
are sent to and completed by this unit (as compared to those sent to 
outside vendors or those completed by District staff in other units). 

Analogous metrics could be developed for other shared services at 
the District, to gauge the extent to which centralized services are 
used by, and valuable to, the operating groups. 

At least one major internal customer of Administration’s services, 
the Water Utility Enterprise (WUE), has dedicated its own staff 
and/or is adding positions to perform administrative functions such 
as (1) recruitment and tracking of positions and (2) Health & Safety 
program development and implementation. It is beyond the scope of 
this audit to investigate the specific events that led up to the WUE 
developing parallel capacities in these areas, but the fact they have 
done so indicates an area of concern. This presents an opportunity 
for Administration, and the District as a whole, to apply its strong 
“customer” orientation as discussed in an earlier finding and address 
these issues. Since the time of the audit fieldwork in this area, the 
District has already taken actions to improve in this regard, 
specifically, through the hiring of a District-wide Health & Safety 
program manager and renewed focus on developing a fully 
functional program. 

The steps above regarding developing potentially parallel capacities 
may have been necessary to address short-term needs of the WUE, 
but in the long term, this development promotes redundancy, 
increases overall cost, and confuses the roles and responsibilities of 
the multiple units and positions involved. 

Although there are individual metrics in place addressing the work 
areas that are involved in the above example, there are no overall 
measures that would inform District management that operating 
groups have developed their own administrative capacities in 
parallel with, and redundant to, functions already in place within 
Administration. 

In addition, despite the generally high level of teamwork and 
cohesion within the CEO’s Executive Leadership Team (the chiefs 
of Administration, the Water Utility Enterprise, Watershed 
Operations, and Capital Program Services) in supporting the CEO 
and Board as documented in the Board and CEO audit memoranda, 
development of redundant functions within an organization are 
usually symptomatic of either a lack of communication throughout 
the organization regarding internal service capability or a significant 
gap between groups regarding the service provided by one to the 
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approved programs and deliver its other services. 


The District’s organizational growth in recent years coupled with 
strategic business planning and staffing decisions being made at the 
department level and not necessarily at the agency-wide level 
suggest that the historical case-by-case procedure for evaluating 
staffing needs and creating new positions does not provide the 
District sufficient documentation or justification for its existing 
staffing levels. Red Oak understands that the most recent District 
budget (FY 06-07), which was under development during the time 
of Red Oak’s fieldwork and was finalized just prior to the 
finalization of this staffing report, contains an explanation of the 
District’s staffing levels over time and their relationship to services 
provided to the community. 

Additionally, based on infonnation provided for Red Oak’s review, 
the District has taken a number of personnel-related steps to position 
itself better for the future, but is currently lacking an agency-wide 
succession plan. This is common within the District’s peer group, 
but forward-thinking public agencies throughout the country are 
currently developing and implementing comprehensive such plans to 
help meet current and future business needs in light of the 
demographic challenges facing all types of organizations. 

Cause The District’s staffing level decisions have historically been made 

largely on a case-by-case request-based process, which is common 
for its peers. However, the District has grown its organization 
significantly in recent years, and the reasons for this growth are not 
apparent to most internal and external interviewees who participated 
in this audit. This suggests that if the organizational growth has 
taken place due to a clear, programmatic need, such as the Clean, 
Safe Creeks initiative as noted to Red Oak during the finalization of 
this report, this has not been clearly communicated to both internal 
and external stakeholders, and may be contributing to inaccurate 
perceptions of the District’s management of its staffing levels. 

Based on Red Oak’s Administration and Financial Services audit 
activities, there is a lack of an overarching, quantitative cost-control 
or overhead minimization goal at the District. If one were in place, it 
would likely be a driver for more rigorous examination of staffing 
levels. Such a cost-control or efficiency goal would most effectively 
be “owned” by Administration , with the Financial Services Division 
supporting the effort with its cost accounting system. 

Effect The District does not appear to have sufficient justification to 
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Recommendation 


Detailed project documentation would help in planning, identifying, and 
mitigating risks. This documentation should be developed prior to a project 
rating and ranking process where projects would be scored based on their 
relative merits and risks. This scoring process will allow a more justifiable 
list of approved projects and aid in the deliberate identification of project 
risks. The individual project information should be included in the IMD 
annual business plan. 


Finding No. 28 - Opportunity 

Key audit objective: “Information management” 


Criterion 

The District should have an IT Master Plan that details the major IT 
initiatives to be conducted over a 3- to 5-year timeframe. The plan should be 
implemented within schedule and budget, and reviewed and updated at an 
appropriate frequency (e.g., annually). 


References: 

• Baldrige 2.1: Strategy Development 

• Baldrige 6.2: Support Processes and Operational Planning 

Condition 

The District developed its most recent Information Systems Master Plan 
(ISMP) in 2001, which delineated a series of projects to be completed over a 
period of approximately three years. One of the major projects, the 
PeopleSoft implementation, proceeded above budget and behind schedule, 
Several of the other major projects (e.g., WRIS and EDMS) were placed on 
hold until only recently. The ISMP has not been updated since its finalization 
in March 2001. 

Cause 

The ISMP may have been overly ambitious in the scope of changes 
occurring over a three-year timeframe, given the other District-wide 
initiatives that were taken on during this time. Additionally, it appears that 
the District did not dedicate business/operating unit staff (subject matter 
experts) to the PeopleSoft implementation on a full-time basis. The $51M 
property-tax funding shortfall caused by the State of California is also a 
reason that some ISMP projects have been delayed. 


Despite the effort placed on the development of the ISMP in 2001, the 
District has not placed a correspondingly high priority on timely 
implementation or updating of the projects in the plan. The ISMP has not 
been updated because many of the original driving forces and issues have not 
changed and staff availability to take on such a project is limited by other on¬ 
going projects. This is closely related to the finding regarding the potential 
benefits of stronger District-wide strategic planning and prioritization 
discussed elsewhere in this memorandum. 
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" American Water Works Association (AWWA) recommended practices in rate-setting and 
financial management 

a Various American Institute of Certified Public Accountants (AICPA) standards generally 
applicable to systems of internal control 

a Knowledge and experience of the Red Oak audit team 

■ Knowledge and experience of District managers and staff familiar with the financial 
operations of the District 


GAO Practice 1.0: Build a foundation of control and accountability that suyports external 
reporting and performance management. 

Key benchmark characteristics: 

1. The financial reporting and audit process is a basic management and oversight tool. 

2. Accountability is part of the organizational culture and goes well beyond receiving an 
unqualified audit opinion. 

3. Internal controls meet both external financial reporting and performance management 
control objectives without significantly impacting efficiency. 


FINDING 1.0(a) - Fiscal Policies and Procedures 


Criterion 

' 

The District should have written fiscal policies and procedures that are key to 
accountability and internal control, providing clear, consistent direction to 
financial staff and user departments. 

Reference: 

Generally accepted audit standards relating to internal controls 

Condition 

The Financial Services Division has developed written procedures for all 
functional areas. In general, these are well-written, complete, and 
appropriate, and have a strong and explicit link to District Board policies. 

The connection to District operating results is not as strongly evident; most 
of the policies referenced are Executive Limitation policies, not Ends 
policies. 

Effect 

There is a sound basis for sustaining a strong system of internal control and 
accountability. The District’s manuals have the basics well covered, and are 
reflective of the current implicit mission of Financial Services, which 
emphasizes control and accountability. 
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FINDING 9.0(b) - Capital projects financing: please see FINDING 1.0 (c) (Reserves and 
Capital Financing) for the discussion of capital projects financing 


FINDING 9.0(c) — Indirect Cost management and allocations 


Criterion 

In order to ensure that customers are paying for services they receive, the 
indirect costs of the District should be allocated to operating functions in a 
reasonable manner that reflects each function’s actual use of the costs of the 
service allocated. This criterion is established in AWWA rate-setting 
standards and in GFOA-recommended practices. 


As specified in the Office of Management and Budget Circular A-87, 
administrative activities allocated to operating functions should be performed 
efficiently and effectively; that is, they should provide essential services but 
should not exceed a reasonable level of cost. 

Condition 

Indirect (administrative) costs are allocated to operating functions by the 
Financial Services Division Manager using reasonable bases of allocation. 
However, the computations are done internally, are not reviewed in detail, 
and are not clearly and formally represented as being in accordance with the 
OMB Circular A-87, which establishes standards for indirect cost studies 
used in support of federal grant reimbursement claims. Specific care is taken 
to ensure that only eligible costs per Circular A-87 are allocated to programs 
for purposes of claiming Federal grant reimbursement. 

There is no comprehensive effort to measure and evaluate the efficiency and 
effectiveness of administrative services. Some administrative functions, such 
as Information Technology, have established customer outreach programs. 
This is discussed in further detail in Red Oak’s Administration audit 
memorandum. Comparison of total administrative costs for the Water Utility 
Enterprise with other California water districts indicates that they are at a 
reasonable level. 

Effect 

In general, the equitable distribution of indirect costs and their overall level 
is defensible. At a more detailed level, our audit interviews indicate that 
customers (both internal and external) do not have confidence that the level 
of cost and the level of service are commensurate, or that the total costs are 
appropriate. 

Cause 

The process is informal and is not clearly communicated to customers. 

Recommendation 

An A-87 indirect cost study should be performed by an independent 
consultant. This will provide a sound basis for federal grant reimbursement 
claims and will provide assurance to District customers that costs are 
allocated equitably among operating functions. 
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“strength” for Watershed Operations for the purposes of this audit 
memorandum for all the reasons noted in the previous bullet points. 

Additionally, as noted in the main body of the final audit report, the 
District reported to Red Oak that it had made significant advances in the 
H&S area between the time of Red Oak’s audit fieldwork and Red Oak’s 
preparation of the final audit report and finalization of this and the other 
individual audit memoranda. Specifically, the District has hired an 
agency-wide H&S program leader, and is moving forward with 
addressing the issues noted above. 

Cause 

Watershed Operations has placed a priority on supporting the District’s 
mission and its Board’s Ends Policies that relate to regulatory compliance in 
general. 

Effect 

Watershed Operations allows the District to generally achieve or exceed its 
goal of compliance with watercourse management regulations and track its 
performance over time, and has processes in place to enable the District to 
continue doing so over the long term. 


Watershed Operations Strength Finding No. 2 
Key Audit Objectives: N/A 


Criterion 

The District should have its Watershed Operations customers clearly 
identified, have established methods for communication with these 
customers, and actively solicit and incorporate feedback for continuous 
improvement. 

References 

• Board Policy EL-2: 2.4 

• Baldrige Criterion 3.1.a.l 
» Baldrige Criterion 3.2. a. 1 

Condition 

Watershed Operations has taken a number of important steps with respect to 
the services it provides to its customers and its customer coordination, 
including the following: 

* Strong community outreach through the Water Resources Protection 
Collaborative. 

• Evaluation and incorporation of Clean, Safe Creeks...Program 
project area customer satisfaction rankings and annual review by 
Independent Monitoring Committee 
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14001 certification. 

8 Developing a thorough set of ISO procedures and measures 
• Exhibiting a high degree of consistency between work processes 
described by interviewees and written procedures 

Some procedures remain undocumented, largely due to the need to update 
and adopt procedure documents and manuals that were developed and used 
prior to the adoption of ISO methods. Nevertheless, Watershed Operations is 
generally ahead of its peers in terms of documentation of procedures. 

Performance measures currently tracked for Watershed Operations tend to be 
very quantitative and are very useful to evaluate cost effectiveness or other 
numeric values relating to project delivery. However, qualitative measures 
relating to tracking cause and effect accomplishments or demonstrating that 
creative or innovative methods are encouraged and desirable can be difficult 
to understand using current measures. 

Cause 

Watershed Operations has generally made documentation of its key 
procedures a priority and staff recognizes when procedures are not complete 
or lack adoption following protocol. As a result, procedures that were 
documented prior to the implementation of ISO procedures are updated and 
adopted to follow ISO protocol. 

Effect 

Watershed Operations is relatively well-positioned to track and report 
accomplishments. A framework for feedback and improvement is well- 
developed. Watershed Operations is able to demonstrate its standard 
procedures to interested parties and to readily train newly hired, laterally 
transferred, or promoted staff. Although this is viewed as a strength, there is 
opportunity to encourage that more creative and innovative methods be used 
to measure service delivery. 


Watershed Operations Strength Finding No. 4 

Key Audit Objectives: “Operational Policies and Procedures ” 


Criterion 


Watershed Operations should establish goals and performance measures for 
natural flood protection, water quality protection, and stream stewardship 
consistent with the voter-approved 15-year Clean, Safe Creeks and Natural 
Flood Protection Program that provides District revenue, and consistent with 
the District’s mission and the Board’s Ends Policies. 

References 

• Baldrige Criterion 4.l.a. 1-3 

• Baldrige Criterion 4.1.b.l-2 

• Board Policy EL- 7.8 
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Condition 

Watershed Operations has taken a number of important steps with respect to 
the Clean, Safe Creeks ... Program, including the following: 

8 Clean, Safe Creeks.,.Program goals and performance measures are 
well-developed and documented. 

8 Each project completed for the program is evaluated for customer 
satisfaction compared to performance measures. 

• An Independent Monitoring Committee provides annual program 
review and reporting. 

Cause 

Watershed Operations facilitated development of a program that was 
approved by the voters and is being successfully implemented. This program 
has four major outcomes as mandated by the voters as follows: 

1. Homes, schools, businesses, and transportation networks are protected 
from flooding. 

2. There is clean, safe, water in [the District’s] creeks and bays. 

3. Healthy creek and bay ecosystems are protected, enhanced, or restored as 
determined appropriate by the Santa Clara Valley Water District Board of 
Directors 

4. There are additional open spaces, trails, and parks along and in the 
watersheds when reasonable and appropriate. 

Watershed Operations has established specific performance measures and 
delivery goals for each of the four major outcomes. 

Effect 

Clean, Safe Creeks...Program goals for natural flood protection, water quality 
protection, and stream stewardship are being successfully accomplished as 
evidenced by associated documents and reports provided by the District for 
Red Oak’s review. Completion of the approved program will help position the 
District to continue gaining voter support. 


Watershed Operations Strength Finding No. 5 

Key Audit Objectives: “Operational policies and procedures ” 

“Cost effectiveness ” 

“Environmental management” 


Criterion 

Watershed Operations should develop procedures and measures for 
accomplishing cost-effective and environmentally sound watercourse 
operation and maintenance. 


References 

• Baldrige Criterion 4. La. 1-3 
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Recommendation 


The District should set a priority to complete its efforts of integrating and 
updating hydrologic and hydraulic models including procedures to assure 
keeping them current and easily accessible. This should include 
consideration of climate change parameters, sea level elevations, and rainfall 
patterns as considered by the DWR. An example of a peer agency that has 
led the development of comprehensive and up-to-date watershed models is 
the Milwaukee Metropolitan Sewerage District in Milwaukee, Wisconsin. 


Watershed Operations Opportunity for Improvement Finding No. 6 
Key Audit Objectives: “Compliance with State and Federal regulations ” 

"Environmental management ” 


Criterion 

A consolidated and coordinated environmental monitoring program should 
be developed to track project accomplishments in a cost-effective manner, 
and to be prepared for future permit conditions. This includes establishing 
consistent and understandable methods to work with regulatory agencies and 
to communicate with the public. 

References 

• Baldrige Criteria P.l.a.5 
® Baldrige Criterion 2. l.a.2 

• Baldrige Criterion 3.2 

Condition 

Factors and activities within Watershed Operations related to this 
opportunity include the following: 

• The current watercourse maintenance permit and monitoring 
program is due for review. 

• Monitoring costs for mitigation areas are increasing and have been 
evaluated by Watershed Operations at the staff level as reported in 
the District document entitled “Biological and Surface Water Quality 
Monitoring Activities Evaluation Report” dated September, 2002. 

• The District is a co-permittee in the SCVURPPP, and is regulated 
under a Phase I NPDES stormwater permit. The FY04-05 Annual 
Report summarizes urban runoff program activities, program 
improvements, and areas where continuous improvement is needed. 

• Related to District-owned storm drain operation and maintenance, 
more focused training at specific facilities is needed, more frequent 
inspections of storm drain facilities are needed. Currently storm 
drain O&M activities are only being implemented through the 
Maximo Preventative Maintenance program for some water 
treatment plants. In addition, some facility Stoma Water Pollution 
Prevention Plans need to be updated. 

• A Municipal Regional Urban Runoff Phase I NPDES Stormwater 
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of the practice” among its agency peers. Documentation reviewed indicates 
the District is active in regional emergency groups (e.g., the Bay Area 
Security Information Collaborative), has procedures for access to the 
Response Information Management System (RIMS), is incorporating the 
Standardized Emergency Management System (SEMS) and the National 
Incident Management System (NIMS) as well as guidance from external 
entities like the Bureau of Reclamation and the California State Office of 
Emergency Services (OES). Auditees also indicated that the District conducts 
joint emergency training/exercising with its retail customers and OES, 
although this was not evident from the materials provided for Red Oak’s 
review. 

An important cross-organizational function that supports the District’s 
emergency preparedness and operations is the WUE’s rainfall, stream-flow, 
and reservoir-monitoring system, and collection and reporting of fundamental 
hydrologic data for both its water supply and flood control functions, as 
evidenced by the Hydrologic Data Management Report and WUE customer 
lists. 

The District’s emergency planning and operations function is organizationally 
located in the WUE (reporting directly to the COO), although it is responsible 
for any type of District emergency, most notably, flooding events. Although 
Red Oak did not obtain any evidence of this organizational placement being 
problematic at this time, the District may wish to address this to (1) make it 
clear to staff and external stakeholders that tire emergency function currently 
housed in WUE is, in fact, a District-wide function and to (2) make clear that 
the District does not generally prioritize its water supply emergency functions 
over its flood-related emergency functions. For example, the District’s Office 
of Emergency Services’ information in the WUE Business Plan does not 
explicitly note that the office/unit supports all types of District emergencies; 
one could infer from its organizational placement that it is dedicated to the 
WUE. 


Cause 

As the watershed operations/flood control and wholesale water supply agency 
for Santa Clara County, the District has considerable emergency response 
experience, and has made agency-wide emergency preparedness a priority, 
including keeping pace with state and federal regulations and industry- 
standard emergency guidelines and systems. 

Effect 

The District’s emergency capabilities are generally well-regarded among staff, 
based on Red Oak’s interviews, and the District has also used emergency 
exercising/training as another method to enhance its customer relationships 
and partner with outside agencies for regional preparedness. 
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Appendix G 


Capital Program Services Audit Memorandum 




actual final cost to provide data for trending analysis and process-related and 
results-related performance measurement. CPS’s performance measurement 
should be developed based on, and link directly to, a District-wide strategic 
plan, CPS’s 5-year capital plan, and the District’s agency-wide performance 
management effort currently under development as discussed in other audit 
memoranda. 


Capital Program Sendees Opportunity Finding No. 7 

Key Audit Objectives: “Compliance with state and federal regulations 


Criterion 

The CPS should track, and be able to demonstrate its compliance with, all 
applicable regulatory requirements associated with its capital program 
activities. These include environmental documentation (e.g., CEQA) 
requirements, storm water pollution prevention requirements, and all other 
applicable regulatory requirements. The District’s compliance demonstration 
should include proof of compliance for past time periods, as well as the plan 
for continued/future compliance. Furthermore, the District should make the 
effort where possible to set internal goals (in conjunction with its customers) 
for meeting and/or exceeding compliance and other expectations in this 
regard as consistent with its vision/mission. 


Reference: 

o Baldrige "Values": Taking opportunities to go ",beyond mere 
compliance ” with respect to laws and regulatory requirements 

Condition 

Based on audit activities, CPS regularly addresses and complies with all 
regulatory requirements associated with planning, design, and construction 
of its capital projects, e.g. CEQA, SWPPP, building codes, noise ordinances, 
and HAZMAT requirements. Bidding and advertising of contracts is in 
conformance with the California Public Contract Code. The District solicits 
input from and, if necessary, secures permits from more than 15 different 
government agencies according to the Design Phase procedural documents in 
the QMS. 


Per its QMS, CPS relies upon project plans and work plans to properly 
identify all applicable regulatory requirements every project needs to comply 
with; and relies on its quality control procedures to ensure each project is 
complying with the identified regulations. However, the QMS does not 
explicitly require documentation of achievement on each project with respect 
to these agencies. Completion of regulatory obligations on each project is 
documented in the work plan and checked by an internal quality assurance 
team member upon completion of each project. 

Cause 

CPS has project plans and work plans in place to note the need for 
comprehensive regulatory compliance on each project; however, CPS does 
not typically use these or other tools to explicitly and separately document 
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Mr. Larry Wilson, Chairman 
Santa Clara Valley Water District 
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The District has adopted a governance structure based on the “Carver Policy Governance 
Model”. This model makes a very clear differentiation between the responsibility of the Board 
to establish policy and the responsibility of the CEO to execute that policy. SCC/MAD has 
correctly pointed out that “the SCVWD Board of Directors has granted broad administrative 
authority to the Chief Executive Officer (CEO) to manage the District’s operations and capital 
programs... [and that]... core budget review and oversight duties typically retained by 
governing boards in other public jurisdictions have also been delegated to the CEO.” Finally, 
SCC/MAD concludes that “the Directors and the Board of Supervisors have relinquished 
considerable budgetary control authority to staff. This could expose the District Board of 
Directors and Board of Supervisors to substantial risk.” 

In our opinion, these observations and conclusions reflect the assumption that the common 
local government paradigm is correct. The Carver model was developed as a corrective for the 
perceived inability of nonprofit and public sector institutions to focus on results and efficiently 
execute their missions. The approach and its concomitant policy and authority structure were 
adopted, with modifications, by the District after careful consideration and after review by 
District legal counsel. We have confirmed through our audit work that there is a clear and 
continuing connection between actions of the Board and established policies and 
responsibilities, and we believe that, in general, the District has achieved a sound balance 
between the responsibility of the Board and the executive authority of the CEO. There are 
government activities that would not fit this model well, generally those where due process is a 
critical consideration, such as criminal justice and social services, significant areas of 
responsibility for the County. With these observations in mind, we offer the following 
suggestions: 

• Our research indicates that the SCC budget review requirement is an artifact of 
political circumstances that existed at the time the District was established. Since that 
happened quite some time ago, it would be reasonable to re-examine the efficacy of 
this process, particularly given the fact that it is not a common requirement for 
California water districts. We recommend that the respective elected officials of each 
entity create a forum for the discussion of this fundamental issue and determine 
whether to initiate legislation to rescind the requirement that the County review and 
approve the District budget. 

• If this requirement is not rescinded, we agree with SCC/MAD that it is imperative that 
a clear, precise definition of the level of review and the responsibilities of all parties be 
developed, documented, and agreed to by both entities. 

• We believe that SCC/MAD makes certain observations regarding budgetary control 
and authority that, once raised, must be dealt with by the District affirmatively. In 
particular, if delegation of budgetary authority to the CEO is to be continued at the 
current level, care should be taken that any significant deviations from the Board- 
approved budget be reported on a regular basis to the Board. This approach balances 
the need for efficiency with the assurance that the Board is informed of the purposes 
for which District resources are being used. District legal counsel should explicitly 
review and agree to the legality of the current delegation approach. 
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o Chief Executive Offices, Financial Services 

• Shields Resource Group (Denise Shields) 

o Initial Data Collection, Audit Planning, Summary of Existing Performance 
Measurement Program, Board of Directors, Chief Executive Offices, 
Administrative Services, Financial Services, Information Management, 
Human Resources, Water Utility Enterprise, Watershed Operations, 

Capital Program Services 

• Janet Morningstar, a Law Corporation (J. Morningstar) 

o Financial Services, Legal Issues 

• Bruce Todd Public Affairs (Bruce Todd) 

o Board of Directors 

» The 3 Point Group (Vem Goodwalt) 

o Chief Executive Offices, Information Management, Water Utility 
Enterprise, Watershed Operations 

III, Audit Standards and Criteria 

A. The audit will be conducted in accordance with Generally Accepted Governmental 
Auditing Standards. The audit will include a review of systems and processes for internal 
controls; examination of documents and records; interviews with staff, customers and 
stakeholders necessary to evaluate the District’s compliance with applicable laws, 
regulations and policies; and, evaluation of the effectiveness and efficiencies of the 
District’s policies, procedures and practices for financial, administrative, operational 
management and capital planning and management. 

B. The audit will also include a review of the District’s policies, procedures, and deployment 
of planning, financial forecasting, budgeting, customer relations, process management, 
information management, communication, and human resources management using the 
Malcolm Baldrige National Quality Program and industry benchmarks and recognized best 
management practices as criteria, such as ISO 9001 and 14001 standards. 

C. Additional criteria to be used in the audit include the Santa Clara Valley Water District Act 
(District Act), Governance Policies of the Santa Clara Valley Water District Board of 
Directors, and applicable provisions of local, state, and federal laws and regulations. 

IV. Reporting of Audit Findings and Disclosure of Significant or Material Findings 

A. Pursuant to Section VII, Scope of Services, the Consultant will provide periodic draft 
interim audit reports (memoranda of findings) containing audit findings and 
recommendations. The memoranda of findings will be issued by the Consultant as draft 
confidential documents and be provided directly and simultaneously to the Chair of the 
Board’s Ad Hoc Audit Committee or his designee, and the District’s Chief Executive 
Officer. Prior to the release of the final draft report upon completion of the audit, the 
Consultant will give District management an opportunity to explain their perspective on 
issues and/or provide the necessary documentation or information. 
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o Water Measurement Unit Manager 
o Utility Raw Water Operations Unit Manager 
o Infrastructure Planning Unit Manager 

o Wells and Water Production Unit Manager 
o Office of Emergency Services Manager 

• Review findings in field with those directly involved, if possible, and 
document feedback 


; Progress Milestone 3.44 $19,911 


3.4.5 Prepare memorandum of findings 

• Prepare draft for internal team review 

• Revise and review with appropriate client representatives (validation meeting) 

• Finalize memorandum of findings 

Task 3.4 Assumptions 

Meetings: 1 total (1 validation meeting) 

Interviews: 8 individual interviews 
Deliverables: 1 preliminary> draft and 1 final draft 
memorandum of findings, delivered electronically 



3.5 Watershed Operations 

Key Audit Objectives: 

Assess the effectiveness and efficiency of: 

Operational policies and procedures 

Compliance with State and Federal regulations 

Assessment of existing practices and comparison with best practices and 
relevant benchmarks: 

o Cost effectiveness 

o Overhead 
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B. 


■ Review the current Audit Work Plan, budget status, and schedule status at the 
conclusion of Tasks 3.1 (Board Audit) and 3.2 (CEO Office Audit). If necessary, 
revise the Audit Work Plan, budget, and/or schedule to incorporate findings and any 
adjustments to approach. 

■ Review current Audit Work Plan, budget status, and schedule status at the conclusion 
of the Administration Section Audit, Task 3.3. If necessary, revise Audit Work Plan, 
budget, and/or schedule to incorporate findings and any adjustments to approach. 

Any proposal to increase the cost of this agreement will require the prior approval of 
the Board’s Ad Hoc Audit Committee and District Board of Directors. See Appendix 
2 for additional provisions relating to Consultant Fees and Payments. 

Prior written approval of the Board’s Ad Hoc Audit Committee Chair is required for any 
changes to the composition of the Consultant’s audit team. The “audit team” for the 
purposes of this statement includes key members of the Consultant’s team, such as the 
Project Officer, Project Manager, Deputy Project Manager, and individual audit leaders. 

In other words, the Consultant need not obtain approval from the District prior to 
changing any junior or administrative support staff on the project team. 

Notwithstanding the foregoing, the District, in its reasonable discretion, may remove any 
membei from the audit team. Except for members of the team removed by the District, if 
the Consultant replaces any member on the audit team (i.e. they leave the employment of 
the Consultant), the Consultant agrees that it will not invoice the District for any time it 
takes the replacement member to become familiar with the audit. 
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February 15, 2007 


Mr. Todd L. Anderson, Project Manager 

Red Oak Consulting, a Division of Malcolm Pirnie, Inc. 

2000 Powell Street, Suite 1180 
Emeryville, CA 94608 

Subject: Transmittal of the Santa Clara Valley Water District’s “Views of Responsible Officials” 
Dear Mr. Anderson: 

Thank you for this opportunity to provide Red Oak Consulting (Red Oak) with the Santa Clara 
Valley Water District’s (District) “Views of Responsible Officials,” attached. It is our 
understanding that Red Oak will incorporate this section into the final audit report, and present 
the final report to the District Board of Directors on Tuesday, March 13, 2007. 

Since the Board requested this audit in 2005, several significant events have occurred, including 
legislation in 2006 that severed the District’s ties with the County of Santa Clara, creating a 
newly independent water district. Greater independence brings with it a greater need for 
transparency and accountability, which the District is realizing partly through external audits. In 
addition to the Red Oak audit, the District, since 2004, has undergone multiple assessments 
from the California Awards for Performance Excellence (CAPE) and the County Civil Grand Jury 
as part of our drive for continual improvement. 

In the audit, Red Oak recognized the District’s performance excellence vision and 
recommended that the District review and synthesize the audit findings together with 
opportunities for improvement from the above assessments. We are following that 
recommendation. The District is using the two overarching issues identified by Red Oak — 
need for organizational cohesion and focus — as a point of alignment in reviewing the nearly 
300 identified opportunities for improvement. 

In addition to moving forward with this review process, the District has also taken quick action in 
response to several audit recommendations, including: 

o Creation of a Chief Financial Officer (CFO) position. 

® Restructuring of the Budget Office and Office of Performance Excellence into a new 
Office of Strategic Management and Budget under the CFO, reporting directly to the 
CEO. 

® Development of a new, District-wide strategic planning and initiative management 

process that will set strategic objectives, prioritize strategic initiatives, and involve input 
from employees and external customers, partners, and suppliers. 

• Hiring of a Health & Safety unit manager and Health & Safety positions in operational 

areas; and development of District-wide Health & Safety training programs for this fiscal 
year. 


The mission of the Santa Clara Valley Water District is a healthy, safe and enhanced quality of living in Santa Clara County through watershed 
stewardship and comprehensive management of water resources in a practical, cosi-effective and environmentally sensitive manner. 








Findings that require a new/revised CEO Interpretation (8) 

Admin 16 

Prioritize Health & Safety 
compliance and organization 

New CEO interpretation/administrative 
policy and procedure needed. 

Admin 36 

Troubleshoot and streamline 
procurement process 

New CEO interpretation/administrative 
policy and procedure needed. 

CPS 1 

Systematically evaluate project 
delivery options 

New CEO interpretation/policies and 
procedures needed. 

CPS 3 

Consider value engineering or 
peer review systematically 

New CEO interpretation needed. 

CPS 5 

Continue constructability and 
operability reviews; facilitate third- 
party reviews 

New CEO interpretation needed. 

FSD 1.0(b) 

Formalize grant application and 
cost-sharing program process 

New CEO interpretation and administrative 
policy needed. 

FSD 1.0(c) 

Reasonable and prudent 
reserves; clarify capital project 
funding process 

New CEO interpretation needed. 

WUE 3 

Standardize consultant 
measurement and management 

New CEO interpretation, administrative 
policies and procedures needed. 

Findings that require a new initiative (16) 

Admin 28 

Update/improve Information Technology master plan 

Admin 29 

Formalize Information Technology project management 

Admin 31 

Automate remaining paper-based processes; revisit underlying work practices 

Admin 32 

Integrate core applications 

Admin 34 

Develop real property disposition policy 

CEO 5 

Consolidate measurement of District performance relative to Ends Policies 

CEO 7 

Formalize agency-wide communications vision/policy 

CEO 8 

Coordinate/align stakeholder communication 

FSD 1.0(b) 

Formalize grant application and cost-sharing program process 

FSD 8.1(a) 

Develop objectives for financial/operational link; improve systems accordingly 

FSD 9.0(a) 

Clear, appropriate fee and rate-setting process 

FSD 9.0(c) 

Provide third-party validation of indirect cost management and allocations 

WO 1 

Established processes to ensure District meets or exceeds compliance 
standards 

WO 1 

Define District's role in floodplain management and relationship to local agencies 

WO 2 

Continue and expedite asset management and costing efforts 

WO 3 

Address gaps in funding needs for District programs 

Findings that require a new ISO procedure (3) 

WUE 1 

Strong focus on regulatory compliance; clear roles and responsibilities 

WUE 4 

Well-documented and maintained emergency procedures 
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WUE 5 

Continue with asset management 
database integration and agency¬ 
wide implementation 

New ISO procedures and administrative 
policies needed. 

Findings that require a new Administrative Policy and Procedure (6) 

Admin 20 

Established policies for use of Information Technology resources 

Admin 23 

Codify District hardware and software standards 

Admin 27 

Develop detailed project documentation for Information Technology initiative 
ranking 

Admin 37 

More closely manage Board Member Request process 

FSD 1.0(b) 

Formalize grant application and cost-sharing program process 

FSD 1.0 (g) 

Perform metric benchmarking of internal service fund charges for decision¬ 
making 


With regard to the OFIs described above, District staff had the option of indicating 
“agree,” “partially agree” or “disagree” for each finding. Staff disagreed with the following 
five findings; for each one, Red Oak’s recommendation and the District’s corresponding 
view is shown. 


District Disagreement with Findings 

Memorandum 
Number 
& Finding 
Type 

Brief Topic of Finding 
or Summary of 
Recommendation 

Clarification/Corrective Actions/Supporting Evidence 

Admin 15 

OFI 

Consider external claim 
file auditing for validation 

Audit Recommendation: While the relatively low number of liability 
claims in the District probably precludes the need for a formal audit on a 
frequent basis, a periodic independent review of certain individual cases 
by an experienced and independent liability claims professional can offer 
benefits to the District, including external validation of the District’s 
practices. 

Liability claims, unlike workers’ compensation claims, can vary widely in 
magnitude, Reserving errors on individual claims likely will have greater 
effect in this line of coverage than in others. While the District appears to 
have an excellent record for valuing and settling claims within estimated 
settlement value, an analysis of the process every five years or so, 
consisting of a review of open claims and an equal number of closed 
claims, could validate the effort and provide assurance to the District that 
its liability claims processes are appropriate. 

District View: The District has too few liability claims to warrant 
independent review. The RMA is a former litigation attorney and works 
with District Counsel to establish appropriate reserves on liability claims. 
Where additional input is necessary, the RMA and District Counsel consult 
outside counsel. An independent review of claim files could pose 
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The key audit objectives for the CEO audit provided to Red Oak by the District were as follows, 
as indicated in Task 3.2 of the scope of work: 


“Assess the effectiveness and efficiency of the CEO’s reporting of compliance with the Board’s 
Ends and Executive Limitation Policies 

Review the District’s customer/partner relationship management practices: 

® Assessment of existing practices and comparison with best practices and relevant 
benchmarks: 

o Effectiveness in conveying District views and positions in the media 
o Effectiveness of the District in influencing water-related policies at the local, state, 
and federal levels 

Conduct an evaluation of the methods and practices used by the District to maintain a positive 
District image and build community partnerships as stated in the Board’s Ends Policies (E-4) ” 


The fieldwork for the Chief Executive Offices audit consisted of the following components: 

° Document reviews 
® Individual interviews with the following: 
o Chief Executive Officer (CEO) 

o Managers of the CEO support offices (District Counsel; CEO/Board Support; 
Government Relations; Ethics, Diversity, and Inclusion; Performance Excellence; 
and Communications) 

o Managers of the District’s four main operating departments (Administration, 
Water Utility Enterprise, Watershed Operations, and Capital Program Services) 

• Questionnaires completed by the District’s CEO and Executive Leadership Team as 
indicated above 

Following the fieldwork and preparation of a draft version of this memorandum, Red Oak (1) 
validated the preliminary findings with the CEO, and (2) presented the findings and 
recommendations to the Audit Committee on October 11, 2005. This final memorandum 
incorporates input provided to Red Oak during these two steps. 

Per the scope of work, the Comprehensive Performance Audit was an objective and independent 
evaluation of the Board of Directors’ (Board) compliance with their Governance Policies, and 
the Chief Executive Officer’s implementation of the Board’s Ends and Executive Limitation 
Policies. To that end, the audit scope was broad (District-wide), but necessarily limited to the 
most important topics to the District as a whole. Therefore, these memoranda generally do not 
contain exhaustive assessments of any District work unit or work process. 

Red Oak maintained the focus on the District’s key issues through the systematic audit 
methodology outlined in the scope of work, which included the establishment of performance 
audit criteria per GAGAS and as demonstrated in the Findings section of this memorandum. 
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sometimes confusing or conflicting messages being delivered to interested 
parties. 

Cause 

The Board and the CEO have not communicated a clear set of priorities for 
communication. The District is spending significant time and resources on 
what appear to be non-core-business activities and somewhat peripheral 
customer groups. The overall impact is not clear due to a general lack of a 
District-wide communications vision and appropriate measurement tools. 

Effect 

The Office of Communications is staffing several Board-mandated programs 
such as “Adopt-a-Creek” and the school outreach program. These programs 
may be in better alignment with other programmatic functions at the District, 
rather than the Office of Communications support function. Other 
departments within the District are sending materials to stakeholders without 
the involvement or input of the Office of Communications. This can lead to 
“mixed messages” being delivered to the public as noted above. Some 
stakeholder communication opportunities may be overlooked due to the 
general lack of coordination of external communication District-wide and the 
lack of a centralized program to define customer groups and determine how 
to build effective relationships with these groups. 

Recommendation 

The District should develop a vision/mission specific to external 
communication. Included in this mission should be a clear and thorough 
identification and definition of the District’s customer groups, as well as a 
plan for relationship maintenance with these groups. Programmatic functions 
should be assessed to determine where they best reside within the 
organization. 


This is an exercise that the District should undertake at the 
governance/leadership level, and that should not be constrained or influenced 
by the existing department/unit responsibilities of the Office of 
Communications or any other unit. When this vision/mission is developed, 
then the CEO, in conjunction with the executive team, can communicate the 
vision/mission through the District as appropriate, and decide how best to 
ensure that the District’s communication efforts include its immediate 
customers and other high-priority recipients of District information. 
Although it is likely that implementation of the District’s communications 
vision will encompass many units, specifically those with significant 
customer interaction, all significant communication objective materials 
should be passed through the Office of Communications prior to publication 
to best coordinate messages and stakeholder communication opportunities. 


Finding No. 8 - Opportunity 


Criterion 


The District should carry out effective communication of its views, positions, 
policies, and significant programs to its immediate customers and 
stakeholders, as well as the public and employees. The District has a goal of | 
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Reference: 

o Baldrige Senior Leadership: 1. la(l) 
o Baldrige Strategy Development: 2. la(l) and 2. lb(l) 

Condition 

The mission and “client” of the Office of District Counsel are not well 
defined. Although it is clear that the District as a whole is the Office of 
District Counsel’s client, and that, as the District's ultimate decision-maker, 
the Board looks to the District Counsel for legal advice, the District Counsel 
is not directly accountable to the Board. Organizationally and from a 
responsibility perspective, the office appears to be at a distance from the 
Board, which raises a question about who is the Office of the District 
Counsel’s actual client. Although unlikely, it is theoretically possible for an 
issue to arise in which the CEO and the Board will need separate legal advice 
on a matter, and it is not clear how that will work in light of the fact that the 
CEO hires, fires, and evaluates the performance of the District Counsel. 

Cause 

The Board and CEO have not communicated a clear mission for the Office of 
District Counsel, or established any priorities or specific direction regarding 
who the office’s client is under different potential situations. 

Effect 

The role of the District Counsel is not clear in the potential event of the 
Board and CEO requiring separate advice. 

Recommendation 

The actual mission of the District Counsel’s office needs to be more clearly 
defined and needs to be clearly understood throughout the District. The 
vision for and mission of the office should be written in a mamier that 
clarifies the role, responsibility, and accountability of the District Counsel’s 
office. 


The office needs a strategic plan (or needs to be a part of a District strategic 
plan) so that the District Counsel, the CEO, and the Board will know what is 
expected of the office, what its performance indicators are, and when the 
Office's professional and support staff needs to be expanded or contracted. 
The strategic plan should be the foundation for the annual performance 
expectations established for the District Counsel and the office as a whole. 


The CEO and the District Counsel also need to work together with District 
department leaders to ensure that expenditure of legal resources and the 
delivery of legal services are timely and are consistent with the District’s 
priorities. 


Related to Finding No. 3, the District Counsel’s office should continue to 
streamline its delivery of legal services to other District departments and 
divisions. With a three-attorney staff, scheduling and prioritization can be 
extremely difficult if all District work units and employees at all levels of 
those units can directly request legal services from the office. Continued 
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Recommendation 


Administrative Officer with quantitative information regarding these 
topics, and allow her to work with the rest of the Executive 
Leadership Team and the CEO to enhance the value of the District’s 
administrative functions to the rest of the organization. 


To the extent possible, and in cooperation with the bargaining 
groups, the District should consider focusing on performance 
measures that include Administration- wide performance in addition 
to the performance of individual units. In addition, the District 
should institute a set of metrics to track the value and cost- 
effectiveness of services provided by Administration to the other 
units and operating groups in accordance with the overall mission of 
the District and its performance expectations. This would provide 
insight into whether or not corporate services are fully utilized, and 
where there are opportunities to eliminate redundancies and/or 
clarify roles and responsibilities. This should probably be performed 
in conjunction with, or just after, the development of a unified, 
agency-wide strategic business plan, as noted in previous audit 
memoranda. 

It may also be appropriate for the leaders of the operating groups 
and Administration , along with the CEO, to undergo focused 
dialogues to build understanding of and group alignment regarding 
the services that Administration provides to the rest of the District. 

Although this is inherently difficult to substantiate with available 
documentation, Red Oak’s audit interviews consistently suggest that 
Administration personnel are strongly oriented toward ensuring 
organizational compliance with the “Executive Limitations” 
components of the Board’s governance policies,. and are not 
necessarily involved in, or measured by, the District’s achievement 
of its “Ends” policies. In a top-performing organization, policies and 
performance measures are developed from the “top down,” and 
aligned such that all work functions share in the organization’s 
success, and share responsibility for complying with set policy. 


Finding No. 6 - Opportunity 
Key audit objective: N/A 



Criterion 


The District should have accessible policies and procedures 
describing how key processes throughout Administration should be 
completed in conformance with the District’s mission and 
governance policies. These policies should be directly linked to the 
CEO’s interpretations of the Board’s Ends Policies so their intent, 


Page 18 of 66 


October 11, 2006 










contracting with professional service consultants and 
construction contractors; however, they believe that their 
internal customers’ interpretation of those policies differs 
from their own, and they are left generally unsupported in 
enforcing, interpreting, and defending these District policies 
and procedures. Red Oak understands that the District has 
established a users group to address problems associated 
with the Contract Administration System (CAS), and this 
group will ultimately address the policies and procedures 
that govern the District’s actions in this area. 

• The District’s policy and CEO Interpretations regarding 
“treatment of staff.” Auditees report that the District has 
experienced a number of instances where employees have 
interpreted negative performance reviews as “mistreatment” 
according to this policy and managers become frustrated 
with the lack of specifics in the policy to respond to such 
concerns. 

Cause 

District management imderstands that policies and procedures are a 
critical tool for internal control. However, the District has not made 
priorities of ensuring the specificity of policies and procedures, and 
designating who is responsible for interpreting and/or enforcing of 
the policies when necessary. 

The root cause of tire example regarding contract services policies 
provided above, for example, may be a lack of clarity and/or 
dissemination regarding the District’s policies with respect to the 
development of contracts, which is leading to different groups filling 
that void by developing their own individual interpretations. Red 
Oak understands some efforts to address this are underway, 
including the draft “CEO Work Plan” and dissemination efforts for 
the existing CEO Interpretations. 

Effect 

Often Administration units struggle between the role of the “policy 
enforcer” and the “corporate service provider.” According to some 
internal customers, Administration staff require these customers to 
exceed requirements promulgated by the Board and/or CEO. Red 
Oak was not able to determine whether this is the case. Regardless, 
the situation as described can lead to delays and cost increases, as 
operating group personnel may be required to resubmit requests to 
Administration, and both sides spend time debating the 
Board’s/CEO’s intent behind the policy and their respective 
interpretations in addition to time spent executing the transaction of 
concern. 
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Finding No. 30 - Opportunity 

Key audit objective: “Information management” 


Criterion 

The District should have staff dedicated to information security. Procedures 
and tools should be established to provide for the protection of the 
infrastructure and data from probable threats, both internal and external. 

References: 

• Board Policy EL-7.5: Asset Protection 

• Baldrige - 4.2a (4): Information and Knowledge Management 

Condition 

The District does not have any staff dedicated to information security. It 
does, however, have a series of procedures for dealing with disaster 
situations. The District also maintains a number of tools for the protection of 
information, including a firewall and anti-virus software. 

Cause 

The District has recognized the need for dedicated information security staff 
but has not yet opened a position for this person. The District has, however, 
committed resources to obtaining and maintaining a variety of information 
security tools to protect information assets. 

Effect 

The District maintains a significant amount of information and a large 
number of IT assets. The need for attention to information security will grow 
as technology becomes more complex and IT becomes a more critical part of 
day-to-day operations. The lack of dedicated attention to information security 
could expose the District to network intrusions, intellectual property theft, or, 
at the extreme, tampering with water operations through the SCADA system. 
(Red Oak did not review any District Vulnerability Assessment or related 
report for this audit, and recognizes that this subject may have been treated 
there as well.) 

Recommendation 

The District should execute its plan to expand its information security 
capabilities. The District should carefully assess the amount of initial 
investment versus system maintenance and operation needs and its current 
staffing levels both within the IMD and within the District as a whole to 
assess whether this could be accomplished via existing staff or via a 
combination of a vendor and existing staff (e.g., whether a vendor could 
provide an initial solution that IMD staff could subsequently implement). 
The IMD should also plan and implement an intrusion detection system to 
determine if and when IT systems have been compromised by internal or 
external entities. 
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APPENDIX D 



RJECDAK. 

CONSULTING 

A DIVISION OF MAtCOtW PIRHlE 


AUDIT MEMORANDUM 


To: Alison Russell, Project Manager, Santa Clara Valley Water District 

Peter Sakai, Contract Manager, Santa Clara Valley Water District 
Larry Wilson, Audit Committee Chair 

From: Robert Lockridge, Financial Services Audit Leader 

Tom Am, Project Officer 

Date: October 11, 2006 

Re: Comprehensive Performance Audit - Audit Memorandum 

Task 3.3.2 - Management of the District’s Financial Resources; Financial 
Services 


This memorandum presents Red Oak Consulting’s (Red Oak) findings documenting the results 
of our audit of the Santa Clara Valley Water District’s (District) management of financial 
resources, focusing on the Financial Services Division in Administration. Red Oak performed 
this audit as a component of its Comprehensive Performance Audit of the District. This 
memorandum represents completion of Task 3.3.2 of Red Oak’s Agreement No. A2921A with 
the District. 

Introduction 

The District contracted with Red Oak to conduct a performance audit of the District. The audit 
fieldwork and this series of memoranda were structured according to the District’s organization, 
using a “top-down” approach beginning with the Board of Directors. Red Oak and the District 
recognized that many audit findings and recommendations would involve one or more 
organizational units. Specifically, this memorandum, while focusing on the Financial Service 
Division in the Administrative Group under the Chief Administrative Officer, incorporates 
findings related to other organizational units having financial management responsibilities. 
Therefore, these memoranda were initially presented as interim, preliminary drafts and remained 
so until the completion of the audit. Upon completion of all audit fieldwork, Red Oak finalized 
the interim findings/recommendations presented in this and the other draft memoranda. 
Therefore, this memorandum is to be considered as one component of Red Oak’s final audit 
report to the District. 

Objectives, Scope, and Methodology 

Red Oak conducted the Comprehensive Performance Audit according to Generally Accepted 
Government Auditing Standards (GAGAS). As a result, this memorandum was prepared in 
accordance with the GAGAS Reporting Standards for Performance Audits (USGAO, 2003). 
Additionally, per the scope of work, Red Oak’s audit included a review of systems and processes 








for internal controls; examination of documents and records; interviews with staff, customers, 
and stakeholders necessary to evaluate the District’s compliance with applicable laws, 
regulations, and policies; and evaluation of the effectiveness and efficiencies of the District’s 
policies, procedures, and practices for financial, administrative, and operational management, 
and capital planning and management. 

The key audit objectives for the Financial Services audit provided to Red Oak by the District 
were as follows, as indicated in Task 3.3 of the scope of work: 


“Assess the effectiveness and efficiency (including compliance with applicable laws) of: 
a. Management of the District’s financial resources: 

i. Fiscal policies and procedures, (including evaluation of management and 

accounting controls, and controls on spending) 

ii. Fee and rate setting processes and practices 

iiu Capital project financing 

iv. Internal service funds 

v. Reserves: 

1. Assess justification and basis for reserves -15 major categories of 
reserves and approximately 58 separate reserves in 10 funds 

2. Review ofpolicies and procedures for the creation and use of reserves 
and compare with prevailing practices in existence at other water 
districts 

3. Verification that reserve balances are consistent with policies (as of 
year ended FY 2003-04 and year to date) 

4. Determine if use of reserves is consistent with purposes (FY 2003-04 
and FY 2004-05 year to date) 

5. Working Capital Reserve - analyze District cash flow by fund (36 
month period) 

6. Self Insurance Reserve - Review actuarial reports for liability and 
workers compensation 

7 . PERS Stabilization Reserve - Assess actuarial reports and funding 
requirements 

8. Water Utility Rate Stabilization Reserve - Evaluate Rate history, 
policies, and procedures 
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asset should bear their fair share of the cost). 

Board and CEO policy direction is particularly important in areas like this, 
where there are legitimate competing goals. In support of policy 
development, it is important that long-range financial planning exercises be 
undertaken to demonstrate the probable future financial consequences of 
varying mixes of debt and equity financing in order to place policy 
development in a realistic context. 

The District should exhibit these behaviors. 

Condition 

The Water Utility Enterprise has recognized that, for various reasons, this 
dialectic has become unbalanced in favor of cash-funding capital projects, 
and has prepared a long-term financial management plan that meets the 
following objectives: 

• Draws down existing reserves to reasonable levels by using any 
surplus to cash-fund capital projects, thereby limiting nonrecurring 
sources of funds to use in funding nonrecurring projects or other uses 
of funds 

• Reduces the revenue-bond debt service coverage ratio to 2.0 

• Stabilizes the long-term balance of equity/debt financing of capital 
projects to 30%/70% 

Watershed Operations’ capital improvements are generally undertaken based 
on a process of adoption by referendum of a program of capital expenditures 
and the provision of cash funding through specified revenue sources. 

Effect 

In Red Oak’s opinion, this approach is reasonable. The District exhibits a 
slightly conservative bias with respect to debt, and reflects an acceptable 
consistency with industry best practices. 

Cause 

The existence of a specialized business unit within the operating departments 
has facilitated the District’s focus on properly analyzing, planning, and 
executing appropriate capital funding approaches. In addition, the Debt 
Financing Officer in Financial Services has worked closely with the business 
unit in developing a well-planned approach to debt financing. 

Recommendation 

Current approaches appear appropriate given the constraints of California 
law regarding funding sources. 

The Board and CEO, supported by financial planning exercises, should 
develop more detailed policy guidance regarding the District’s debt 
financing. 
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changes in the first instance appropriately resides with the CEO under the 
District’s adopted governance model. 

It is Red Oak’s observation that key planning documents are developed 
through a process that includes broad community and District committee 
participation, that Board members fully participate in that process and are 
knowledgeable regarding District plans, and that the Board is provided with 
key planning documents. Since these documents are public records, 
provision to the Board of Supervisors is clearly appropriate. 


FINDING 1.0(e) 

-*--—------1 

- Article XIIIB (Gann Expenditure Limitation)/ Prop 218 compliance 

Criterion 

The District should demonstrate compliance with relevant laws and 
regulatory requirements, a key element of internal control. 

Condition 

Compliance is annually verified by the Director of Financial Services and 
reported to the CEO. 

This important internal control procedure is implemented appropriately. 

Effect 

The District is in compliance with these Constitutional provisions. 

Cause 

A process for ensuring compliance has been incorporated into the District’s 
budget process. 

Recommendation 

Continue the existing procedure. 

FINDING 1.0(f) - 

Investment policies, procedures, and practices 

Criterion 

Investment policies and procedures should be structured to generate 
reasonable returns on District cash balances in the context of compliance 
with Board policy and legal restrictions. 

Condition 

These are appropriate for a public entity such as the District and are well 
documented. Compliance is carefully monitored by Financial Services 
Division management. Any instances of noncompliance are reported to the 
CEO and Board per Board policy. 

This area is well-managed from a procedural and a compliance standpoint. 
Performance review is conducted in-house by comparison to the Local 
Agency Investment Fund (LAIF) index and to the Santa Clara County 
investment portfolio. 

Effect 

In general, the District is protected from noncompliance by its policies and 
practices. The standard for performance comparison may not be challenging. 
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» Baldrige Criterion 4.Lb. 1-2 

« Baldrige Criterion 6.2. a 

• Board Policy EL- 7.8 

Condition 

Watershed Operations has taken a number of important steps with respect to 
operations and maintenance, including the following: 

• Stream maintenance procedures and performance measures are 
documented and reported. 

• Staff are hired and trained to follow procedures and document results. 

• Numerical tracking of both performance and costs is being 
accomplished. 

• Mitigation measures accomplish environmental goals. 

Cause 

Watershed Operations staff are successfully performing watercourse operation 
and maintenance activities. 

Effect 

Watercourse facilities are managed and maintained using best practices and 
environmentally sound methods. 


Watershed Operations Strength Finding No. 6 
Key Audit Objectives: "Environmental management ” 


Criterion 

Watershed Operations should develop a consistent and systematic approach, 
which is consistent with the District’s mission, for watershed stewardship 
and the comprehensive management of water resources for the joint use by 
cities, the County, and the District. 

References 

• Baldrige Criterion 2.1.a-b 

• Baldrige Criterion 2.2. a 

• Baldrige Criterion 3.2. a. 4 

• Board Policy EL- 7. 8 

Condition 

Watershed Operations has taken a number of important steps with respect to 
watershed stewardship, including the following: 

• A stewardship planning process has been developed and applied. 

• Stewardship Plans are completed in Coyote Valley and are in final 
development for the Lower Peninsula, West Valley, and Guadalupe 
watersheds. 

• These plans offer the opportunity to link projects with other planning 
activities at the District such as water supply and stormwater 
management. 
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out coordination on operations as one of the District’s strengths. 


Cause 

The WUE has placed a priority on documentation of its key operational 
policies and procedures. 

Effect 

Written documentation of existing practices is a key component of 
becoming well-positioned for the future with respect to retaining 
institutional knowledge resident in senior staff approaching retirement. (Red 
Oak recognizes that the District, like its peer agencies, faces significant 
other challenges with respect to comprehensive succession planning and 
preparedness, which is addressed in the main body of the final audit report.) 

It also results in the District being able to demonstrate its standard 
procedures to interested parties, and to readily train newly hired, laterally 
transferred, or promoted staff. 


WUE Strength Finding No. 7 

Related Key Audit Objective: “Operational policies and procedures” 


Criterion 

The District should have quality assurance procedures in place to identify 
deficiencies, make corrective and preventive actions (and track the status), 
and evaluate the effectiveness of corrective and preventive actions within its 
Water Utility Enterprise. 


The District should have a systematic process in place to research and share 
Water Utility Enterprise best practices (e.g., groundwater management, water 
supply/treatment, wholesale water provision) in place among its peer 
agencies, as well as research applicable business practices in place in 
outstanding organizations outside of the water industry. 


References 

® Baldrige Criterion 1.1. a. 3 
® Baldrige Criterion 4.l.a.2 
• Baldrige Criterion 6.1.a.4 

Condition 

The WUE is to be commended for its generally high level of water industry 
knowledge and coordination and incorporation of best practices from other 
entities where applicable, as evidenced by documents provided for Red 
Oak’s review such as program plans and annual reports. Examples include: 


© Participation in statewide water use efficiency knowledge-gathering 
efforts. 


® Work with the Pacific Institute on water use efficiency. 
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asset-management approach as described briefly here is becoming the 
industry standard for similar agencies to the District. This topic is discussed 
at the District-wide level in the main body of the final audit report. 


All findings presented in this memorandum, particularly the recommendations, are to be 
considered as one component of the final audit report prepared by Red Oak. 

Views of Responsible Officials 

“Views of Responsible Officials” are included as a component of the main body of the final audit 
report. 

Nature of Any Privileged or Confidential Information Omitted 

No privileged or confidential information was omitted from this audit memorandum. 

References 

The reference list for this and all audit memoranda is included in the main body of the final audit 
report. 
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Appendix H 


Memo Report on Recommendations by the 
Santa Clara County Board of Supervisors 
Management Audit Division Regarding 
the District’s FY 2005-2006 Budget 









Title _ 

Board Communication - Hot Issues 

Board Communication Guidelines and associated forms 

Board Member Request Process 

Board of Directors General Information 

Board of Directors Meeting Agendas 

Board of Directors Meeting Minutes 


Board Policies 
Board Profiles 
Board Scheduling SOP 1 

Board Work Study Session, Summary of Questionnaire Responses 

Board-controlled Correspondence Process diagram 

Broker Performance Evaluation worksheet 

BSI Continuing Assessment Visit Report 

BSI Continuing Assessment Visit Report - Watershed Operations 

BSI Reassessment Visit Report 

Budget FY 2005-2006 and associated presentation 

Bulletin 155-77: General Comparison of Water District Acts 

Bulletin to Management: Human Resource Activities, Budgets and Staff 

Business Support - 2005/06 Budget 

Business Support - Policies and Procedures 

California Prospector Feedback Report 

Capital Improvement Plan June 2006 (Draft) 

Capital Improvement Plan: Q2 FY 2006 10-yr Update 
Capital Improvement Program Resource-loaded Schedule (Draft) 

Capital Program Services 2006-2007 Business Plan 

Capital Program Services Annual Business Plan, Fiscal Year 2006 

Capital Program Services Organizational Chart 
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o Environmental management 

3.5.1 Develop plan and schedule for background research 

3.5.2 Conduct background research 

« Review regulatory requirements and documents containing policies, plans, 
procedures, operations and current project activities 

• Review results of recently completed ISO audit 

• Interview COO of Watershed Operations 

3.5.3 Develop audit approach 

• Identify potential audit criteria, including, Carver model, Baldrige criteria, the 
District Act, Ends policies, the District’s methods for defining unit costs 
associated with its watershed operations, Ordinance 83-2, Community Rating 
System (National Flood Insurance Program), federal and state environmental 
policies and regulations, stream restoration/riparian enhancement guidance 
manuals, and publications of WEF, AWWA, Association of State Flood Plain 
Managers, American Water Resources Association, and USACE 

• Select critical criteria for audit 

9 Establish appropriate timeframe to be audited 

• Determine how the condition will be measured for comparison to criteria and 
how conclusions will be validated with District representatives 

• Prepare audit instruments and detailed work plan 

• Conduct internal and client review, revise 


Progress Milestone 3.5.3 



3.5.4 Conduct audit fieldwork/deskwork 

• Conduct 9 additional interviews (3 per watershed division) 

• Review key product, service, and business processes 

• Review existing performance measures and targets 

• Evaluate compliance with regulations as well as internal audit criteria 
including greened aspects of conducting watershed operations activities (e.g. 
natural stream restoration, mitigation banking activities, riparian environment 
protection) 

• Evaluate compliance with permit conditions based on review of 
documentation and interviews 

• Assist District to prepare for stream maintenance program effectiveness 
meeting with USACE 

• Execute othei specific audit tasks and draft findings for each 

• Review findings in field with those directly involved, if possible, and 
document feedback 
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other environmental/regulatory requirements and documents, the District’s 
capital project process from planning and permitting through design and 
construction, and the District’s incorporation of the “greener” component of 
its mission into its CIP function. 

9 interview Deputy Operating Officer, Watershed Management Capital Program 
Manager, and Water Utility Capital Program Manager 

3.6.3 Develop audit approach 

9 Iden tify potential audit criteria, including, Carver model, Baldrige criteria, the 
District Act, Ends policies, federal and state environmental policies and 
regulations, the District’s internal goals regarding aspects of its CIP execution 
(e.g„ budget, schedule), ANSI requirements, CSI standards, AIA standards 
and EJCDC standards 

• Select critical criteria for audit 

• Establish appropriate timeframe to be audited 

• Determine how the condition will be measured for comparison to criteria and 
how conclusions will be validated with District representatives strategies 

• Prepare audit instruments and detailed work plan 

• Conduct internal and client review, revise 


Progress Milestone:3;6.3 


3.6.4 Conduct audit fieldwork/deskwork 

• Conduct up to 3 additional interviews based on critical criteria selected in 
Task 3.6.3 

9 Review key product, service, and business processes 

• Review existing performance measures and targets 

• Evaluate compliance with regulations as well as internal audit criteria 
including gieener aspects of conducting Capital Program activities (e.g,, 
incorporation of environmental criteria/features into the planning, design, and 
construction process, mitigation activities) 

9 Evaluate compliance with internal CIP goals and permit conditions based on 
review of documentation and interviews 

• Review construction document standards and procedures 

• Assess construction document recordkeeping procedures 

• Evaluate allocation of resources to support construction and engineering 
services 

9 Assess project closeout policies and procedures 

8 Review CADD standards 

• Assess interface of CADD with engineering design, construction, and 
surveying units 

• Evaluate surveying/mapping procedures 
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4. Overview of Audited Organization 


The District is the primary water resources agency for Santa Clara County, California. It is 
the County’s drinking water wholesaler and flood protection agency, and the steward of 
the County’s streams and creeks, groundwater aquifers, and District-built reservoirs. The 
District is governed by a seven-member Board of Directors, five of whom are elected from 
geographic areas that coincide with the County’s supervisory districts, and two of whom 
are at-large members appointed by the County’s Board of Supervisors. The District is led 
by a Chief Executive Officer and is organized into four main departments: Administration, 
Watershed Operations, the Water Utility Enterprise, and Capital Program Services. The 
appended interim memoranda contain specific overviews of each of these audited 
departments within the District’s organization, and reflect the organizational structure of 
each at the time they were audited. More detailed overview information of the District is 
readily available in many forms, two of which are its website () and its annual 
comprehensive budget document. 

A key development that occurred during Red Oak’s performance of this audit was 
introduction and passage of legislation that will enable the District to approve its own 
annual budget without the additional approval of the Santa Clara County Board of 
Supervisors, effective January 1, 2007. Additionally, the District will be transitioning to a 
five-member Board of Directors from its historical seven-member board as a component of 
this legislation. This audit report and its attached memoranda reflect the District’s 
budgetary approval process and Board composition at the time of Red Oak’s fieldwork 
(June 2005 through August 2006). 
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6. Scoring of Findings 


As described in prior sections, this report presents Red Oak’s findings from the entire 
audit; over-arching findings are presented in the main body of this report according to 
Baldrige categories, and individual, discipline-specific findings are generally presented in 
the appended audit memoranda. Red Oak prepared a table, presented on the following 
page, of all audit findings to enable direct comparisons of recommendations and facilitate 
the District’s consideration and implementation of each. This enables relatively specific 
recommendations discussed in detail in the interim audit memoranda to be prioritized and 
reviewed alongside District-wide issues discussed in the main body of this summary report. 

Red Oak has assigned four types of scores to each recommendation based on the (1) 
current variance between “criteria” and “condition,” (2) likely cost of implementation, (3) 
likely time required for implementation, and (4) expected difficulty of implementation of 
each. Red Oak recognizes that many factors influence the future cost, time, and difficulty 
of implementation of these recommendations such as organizational culture issues and 
externally imposed priorities. In addition, there are interrelationships among many of the 
findings/recommendations that are impractical to capture during this audit and that will 
manifest themselves as the District’s organization continues to evolve. 

Red Oak scored the current variance between “criteria” and “condition” from “1” to “5,” 
with a score of 5 regarded as essentially no such variance. In other words, a 5 indicates a 
clear “strength” finding, where the condition meets the criteria. A score of 1, on the other 
hand, indicates the greatest relative level of variance between the condition and criteria, 
i.e., a relatively high degree of opportunity for improvement. 

It is important to recognize that these relative scorings are based on the District’s 
condition at the time of completion of audit fieldwork. Red Oak recognizes that there are 
a number of audit findings that the District has addressed between the time of fieldwork 
completion and the preparation of this report to the extent that Red Oak would assign a 
higher relative score were the audit fieldwork underway at the time of this writing. An 
additional challenge is that the individual audits were conducted over the span of 
approximately 14 months, such that the completion of audit fieldwork for the Water 
Utility Enterprise, Watershed Operations, and Capital Program Services audit was roughly 
a year later than the completion of audit fieldwork for the first individual audits (the 
Board and CEO audits). Therefore, the following table does not necessarily represent the 
entire District at a single point in time, but rather the state of each individual finding at the 
time of completion of fieldwork for the associated audit area. 

Red Oak designated the cost of implementation as either “A,” “B,” or “C,” corresponding 
to a relatively low, medium, or high expected cost of implementation, respectively. The 
likely time required for implementation was similarly divided into A, B, or C categories 
corresponding to relatively short, medium, or long expected durations for the District to 
improve the condition of each finding from the present to the recommended state. The 
third category, difficulty of implementation, is intended to roughly reflect the amount of 
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Section 11 

Baldrige Category 5 - Human Resources Focus 


urgently needed position (e.g., a position responsible for immediate/daily operational or 
regulatory compliance) as compared to a position responsible for more long-term or less 
immediate duties. 

One effect of the District’s inability to hire and retain essential positions is described in the 
Health &c Safety finding in the appended Administration memorandum and noted 
elsewhere in this report. In general, the effect of this condition is that the District does not 
have a systematic method by which it can quickly fill immediately needed positions as 
compared to those that are less urgent. 

The District should establish and adhere to a hiring priority list based on the relative 
position importance to the core business of the District. One method for accomplishing 
this is for the CEO, in cooperation with the chiefs, to establish the list and task Human 
Resources with implementing the list when responding to position requests from unit 
managers under the current hiring approach. The District has indicated to Red Oak that, 
since the time of the audit fieldwork, it has already initiated discussions regarding 
implementation of such a priority list or otherwise addressing this audit finding. 


11.5. Succession Planning 


Red Oak found during this audit that the District has taken a number of personnel-related 
steps to position itself better for the future, but is currently lacking an agency-wide 
succession plan. This is common within the District’s peer group, but forward-thinking 
public agencies throughout the country are currently developing and implementing 
comprehensive succession plans to help meet their current and future business needs in 
light of the demographic challenges facing all types of organizations. 

Like other efforts at the District, succession planning is an effort that is originating from 
the “bottom-up,” that is, from the staff or unit manager level in one area of the 
organization, as compared to being a clear, agency-wide, formal undertaking. Specifically, 
Capital Program Services is developing a “Skills, Knowledge, and Capability Study” to 
identify human resource needs relative to current and future capital project execution 
needs. Like asset management, the District is to be commended for taking steps in the right 
direction within one area of the organization, but has the opportunity to build upon the 
ideas resident in one area of the organization regarding an effort (in this case, 
comprehensive human resource management and succession planning) that would best be 
a single, agency-wide coordinated effort. Addressing this area could enhance the District’s 
position relative to Baldrige Item 5.1.C.3 as it pertains to how effectively succession 
planning is accomplished. 
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o Creation of a Chief Financial Officer (CFO) position, and the appointment of Peter Ng to 
that position, 

• Restructuring of the Budget Office and Office of Performance Excellence into a new 
Office of Strategic Management and Budget under the CFO, reporting directly to the 
CEO. 

<9 Development of a new, more inclusive District-wide strategic planning and initiative 
management process that will set strategic objectives, prioritize strategic initiatives, and 
involve input from employees and external customers, partners, and suppliers. 

® Hiring of a Health & Safety unit manager and dedicated Health & Safety staff in 

operational areas; and development of District-wide Health & Safety training programs 
for this fiscal year. 


The following six themes describe areas of greatest strength as well as those needing greatest 
improvement, as described in the Red Oak audit report. As stated above, the District agrees 
that addressing the over-arching needs for organizational cohesion and focus is necessary for 
top performance. 


Key Red Oak Audit Themes 


Strengths 

Areas for Improvement 

The District is very strong in individual 
professional disciplines throughout the 
organization. 

The District lacks the well-developed, 
organization-wide cohesion in planning and 
execution that would set it apart from its 
peers and that is a trademark of top¬ 
performing public and private-sector 
organizations. 

The District is very strong in department or 
business-level strategic business planning. 

The District lacks a true agency-wide 
strategic business plan. 

The District is pursuing continuous 
improvement and striving for excellence, 
including adopting a policy governance 
model; pursuing ISO registration 
throughout the organization; and 
developing agency-wide performance 
measurement aligned with the Bcilclrige 
program. 

Certain fundamentals need focus, including: 

® Health and Safety 
® Floodplain management definition 
• Implementation of a complete 

Enterprise Resource Planning system 
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CONSULTING 


AUDIT MEMORANDUM 


To: Alison Russell, Project Manager, Santa Clara Valley Water District 

Peter Sakai, Contract Manager, Santa Clara Valley Water District 
Larry Wilson, Audit Committee Chair 

From: Tom Am, Project Officer 

Robert Lockridge, Board of Directors Audit Leader 

Date: October 11, 2006 

Re: Comprehensive Performance Audit - Audit Memorandum 

Task 3.1- Board of Directors 


This memorandum presents Red Oak Consulting’s (Red Oak) findings documenting the results 
of our audit of the Santa Clara Valley Water District’s (District) Board of Directors (Board). Red 
Oak performed this audit as a component of its Comprehensive Performance Audit of the 
District. This memorandum represents completion of Task 3.1 of Red Oak’s Agreement No. 
A2921A with the District. 

Introduction 

The District contracted with Red Oak to conduct a performance audit of the District. The audit 
fieldwork and this series of memoranda were structured according to the District’s organization, 
using a “top-down” approach beginning with the Board of Directors. Red Oak and the District 
recognized that many audit findings and recommendations would involve one or more 
organizational units. Therefore, these memoranda were initially presented as interim, preliminary 
drafts and remained so until the completion of the audit. Upon completion of all audit fieldwork, 
Red Oak finalized the interim fmdings/recommendations presented in this and the other draft 
memoranda. Therefore, this memorandum is to be considered as one component of Red Oak’s 
final audit report to the District. 

Objectives, Scope, and Methodology 

Red Oak conducted the Comprehensive Performance Audit according to Generally Accepted 
Government Auditing Standards (GAGAS). As a result, this memorandum was prepared in 
accordance with the GAGAS Reporting Standards for Performance Audits (USGAO, 2003). 
Additionally, per the scope of work, Red Oak’s audit included a review of systems and processes 
for internal controls; examination of documents and records; interviews with staff, customers, 
and stakeholders necessary to evaluate the District’s compliance with applicable laws, 
regulations, and policies; and evaluation of the effectiveness and efficiencies of the District’s 









d. When the performance target on a specific measure is not met, why 
that is the case 

e. Who or what department is responsible for developing and 
implementing an action plan for improvement when a performance 
target is not met 

f. Action plan steps 

Adding information on why performance against a specific target is not met will 
allow for a greater understanding of the drivers of a particular measure, the root 
cause of the problem, and a clarification if something is out of the District’s 
control to address. This information will help to keep the organization from 
assigning blame and enable it to collectively work toward improvement. 

6. Timely Implementation and Consistency. The District’s performance measurement 
program has been in development and/or flux for several years, and has changed 
frameworks (e.g., Ends policy measures, Balanced Scorecard, Baldrige) on 
multiple occasions. We recommend that the District conclude the development 
phase of the program and begin implementation as soon as is practical for two 
main reasons: (1) it will maximize the credibility of the program among District 
staff, and (2) it will enable the use of a consistent system from year to year, 
enabling the measurement of trends in the District’s key performance areas over 
time. 
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Finding No. 7 - Opportunity 
Key audit objective: N/A 


Criterion 

The planning, priority, and execution of the District’s 
Administration functions should support the District’s overall 
strategic business plan, and directly support the business plans of the 
District’s operating groups (Water Utility Enterprise, Watershed 
Operations, and Capital Program Services). 

References: 

• Baldrige - 6.2: Strategy Development 

• Baldrige - 2.2: Strategy Deployment 

• Baldrige - 6.2: Support Processes and Operational Planning 

Condition 

Administration managers consistently report difficulty in obtaining 
higher-level direction or consensus regarding the prioritization of 
projects/programs assigned to or expected of their respective units. 
When assigned or delegated a new program, unit managers within 
Administration are unclear as to whether the program is to receive 
higher priority over preexisting “core” duties, or another solution 
developed. This is also discussed in the main body of the final audit 
report. 

The annual budgeting process, despite its high level of detail and 
quality, as noted in Red Oak’s audit memorandum on the District’s 
financial practices, appears to be insufficient to set annual priorities 
for managers and staff. Major new initiatives are often rolled out 
during the year, without revisiting the staff projections and 
expectations set in the budget at the start of the year. The budget is 
written without any room for unforeseen opportunities, so it is 
inevitable that when a new initiative appears, there are no resources 
available for it. This results in frustration and confusion among 
managers and staff regarding their priorities. Managers and staff are 
left without direction regarding how to make trade-offs between 
their existing services and new initiatives, making it difficult for 
them to deliver either. 

Cause 

The District undertakes a rigorous annual budgeting process, as 
discussed in more detail in Red Oak’s accompanying audit 
memorandum addressing financial functions at the District. Though 
the budgeting process should be the annual prioritization process, it 
does not consistently serve during the year as the sole “governor” on 
what the District is and isn’t able to undertake during a given budget 
period. 
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property for insurance purposes by several means, including a periodic 
full valuation study from an outside firm specializing in such work 
(American Appraisal). Between full valuation studies the District uses 
the services of a recognized valuation company’s (Marshall Swift) 
software program to update values. 

Cause 

The Risk Management Administrator (RMA) and the District’s 
property insurer and insurance broker have worked together to make 
sure that accurate values are maintained. 

In addition to use of the outside services, the RMA reviews 
construction costs of new properties and evaluates the work of the 
outside valuation consultants. The RMA also arranges for photographs 
of every building and plats of all locations for the District’s records. 

Effect 

Maintaining accurate values helps assure the adequacy of property 
insurance policy limits. Valuation exercises (because of the precision 
required) also help assure that all properties are identified and none is 
uninsured, thereby reducing the chances of an uninsured loss. In 
addition, accurate property valuation helps prevent overpaying 
insurance premiums. While other, less formal methods of property 
valuation are used by some organizations, the approach the District is 
taking is preferred. Red Oak understands that the District contracts 
with a single firm (American Appraisal, as noted above) for its 
valuation studies. The District should consider periodically working 
with other firms to gain a different perspective when it performs full 
valuation studies. 


Finding No. 13 - Strength 

Key audit objectives: “Risk management/insurance costs ” 

Criterion The District should have a formalized system in place for identifying 

and estimating the magnitude of potential causes of loss so that 
appropriate treatment measures may be applied to mitigate risk or to pay 
for loss that occurs. 

References: 

® Board Policy EL- 7 (7.1): Asset Pro tection 
« Baldrige - 1.2: Governance and Social Responsibility 

Condition The District is to be commended for having developed multiple 
approaches for identification and measurement of loss potential. These 
include quarterly reviews of information reports and data, and 
_participation by the Risk Management Administrator in project planning 
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(H&S) Program is seriously deficient with respect to industry best 
practices, and at least one area where the District is behind current 
industry standard H&S practice. This document also referenced 
previous third-party evaluations of the District’s Health and Safety 
functions that noted deficiencies. These facts, combined with 
auditee input, indicated at the time of Red Oak’s audit fieldwork that 
there was no measurable improvement in the program and that the 
District may continue to be out of California Occupational Safety 
and Health Administration (Cal-OSHA) regulatory compliance in at 
least one area. 

The District also reports difficulties in recent years attracting and 
retaining qualified individuals to lead its H&S program. 
Furthermore, Red Oak found that components of the District’s H&S 
function appear to reside in both Administration and the operating 
groups. Such an arrangement can be effective when done by design; 
for example, to centralize the programmatic compliance tracking 
functions and “outplace” the field-level H&S activities to operating 
groups. Red Oak’s audit activities, however, indicated that H&S 
functions residing in different areas at the District were more a result 
of operating groups developing their own programs than the result 
of an agency-wide H&S organizational design. 

Please note that this finding by Red Oak is not intended to duplicate 
or supersede those findings made by other consultants, such as the 
specialty H&S consultants previously commissioned by the District 
as noted above. Red Oak constructed this finding to complement 
other, more technical findings the District may already have 
received in the H&S area, and to audit the District’s H&S condition 
in the context of the rest of the organization and the District’s 
overall goals. 

Cause 

The District’s H&S Program has been relocated organizationally 
multiple times in the past few years, in conjunction with the 
departure of key program personnel from the District. As a result, 
the current Health and Safety Program has struggled to meet its 
program objectives. The root cause of the condition noted above is 
that the District has not placed a high enough priority on staffing 
and implementing a program that is fundamental to the day-to-day 
operations and regulatory compliance of the District. 

Effect 

The lack of a robust employee Health and Safety program puts the 
District at higher risk of employee injury and workers’ 
compensation claims. Furthermore, the fact that time and funds are 
directed towards less urgent activities at the District (e.g., diversity 
events, general public/school outreach) while basic compliance 
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Recommendation Red Oak recommends that the District clarify the capital projects funding 
process by using the following approach: 

1. Formally appropriate funds only for current-year 
expenditures. 

2. Reserve funds for expected future-year expenditures under 
current contracts, specifying the projects and timing of future 
expected expenditures. However, if District legal counsel 
believes that current contracts should be appropriated in the 
amount of the entire contract, then this legal requirement 
should take precedence. Expected annual expenditures for 
future years through the life of the project should be detailed 
in supporting documentation 

3. Restrict funds that are limited in general purpose by external 
requirements (e.g., inter-governmental agreements, voted 
levies, legal funding source restrictions), specifying in as 
much detail as possible the planned specific future projects to 
which those funds are expected to be applied. 

4. Designate funds that have been earmarked for future projects 
by District management or the Board, providing as much 
detail as possible on the expected expenditures by year and 
project. 

This approach should provide a clear understanding of the status of these 
funds so that policy-makers are aware of their options. 

The large variance between reserve levels and actual claims indicates the 
need to reevaluate the level of self-insurance reserves. Red Oak identified 
this issue during the risk management review, reported in the separate 
Administration memorandum, and understands that a review of the 
confidence levels for establishing reserves is underway. Red Oak has also 
recommended that a periodic independent review of liability claims should 
be undertaken, as noted in that memorandum. 

The Board and CEO should address the matter of reserves from a policy 
perspective and provide appropriate guidance to staff for financial planning 
and budgeting purposes. 


Criterion The GFOA and Fitch Ratings have emphasized the importance of 

establishing policies regarding the use of debt. There is a dialectic in utility 
management between meeting reasonable credit-worthiness goals (rating 
agencies recommend some degree of equity financing of capital projects in 
order to decrease future fixed costs) and intergenerational equity (based on 


cost responsibility principles—those who benefit from the use of a long-term 
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Nature of Any Privileged or Confidential Information Omitted 

No privileged or confidential information was omitted from this audit memorandum. 

References 

The reference list for this and all audit memoranda is included in the main body of the final audit 
report. 
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defined with respect to the goals and needs of floodplain 
management. 

• The District’s activities that affect floodplain limits and/or channel 
capacity are not systematically coordinated with, or reported to, the 
local communities who would potentially benefit from such 
information with respect to the NFIP. 

• Flood preparedness, response and recovery and flood prediction or 
warning for District owned facilities is a critical component of flood 
plain management for local communities and property owners. 

Cause 

Communities are responsible for the NFIP program, which uses base flood 
elevations (BFE) to manage activities in floodplains. Floodplain limits and 
BFEs can be changed by District projects and operations. However, there is 
currently insufficient coordination between the District and its local 
communities, and the District has not yet defined its role and responsibility 
with respect to floodplain management and the NFIP. In other words, Red 
Oak’s review of District documentation and consistent verbal input from 
auditees indicated that the perception local agencies have of the District with 
respect to floodplain management probably does not match the services the 
District provides. 

Effect 

The District’s flood protection services and project activities can impact 
local floodplain management. This could imply a level-of-service defined by 
protection for the 1-percent flood, but the District has not defined its level- 
of-service as being based on the 1-percent flood (or any other single 
recurrence interval). Because District standards and flood protection 
activities alter the level of flood protection provided by each channel, local 
communities within the District can obtain reduced Flood Insurance Rates if 
they participate in the NFIP Community Rating System (CRS). However, 
based on information provided to Red Oak, this potential benefit may not be 
fully realized because of the lack of systematic coordination noted above. 

Recommendation 

The existing CPAR 101 on floodplain management should be addressed in 
comprehensive manner to guide the clear definition of core services and 
level-of-service with respect to flood protection for Watershed Operations 
and clarify the definition of how the District participates and supports 
floodplain management in Santa Clara County. An example of a peer 
agency that has developed its role and involvement in local floodplain 
management is the Milwaukee Metropolitan Sewerage District in 
Milwaukee, Wisconsin. 
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Watershed Operations Opportunity for Improvement Finding No. 2 
Key Audit Objective: “Cost effectiveness ” 

“Operational policies and procedures ” 


Criterion 

Asset protection and management of Watershed Operations facilities and 
assets should address life-cycle considerations and costs, that is, “go beyond” 
the capital/construction phase and include condition determinations with 
scheduled replacement of existing facilities, providing multiple benefit 
enhancements where appropriate. 


References 

• Baldrige Criteria 4.2. a & 4.2.c 

• Baldrige Criterion 6.2. b.l 

• Board Policy EL-7.8 

Condition 

Factors and activities within Watershed Operations related to this 
opportunity include the following: 


• An asset management program is a recognized need for Watershed 
Operations and plans are under development to accomplish this work. 

• Life-cycle replacement costs for watershed facilities are generally not 
known. 

• Best practices in this area for flood/watershed management entities 
are limited, and will require that the District develop some new 
methods. In other words, the District is on par with its peers with 
respect to asset management of watershed/flood control assets, but 
has a significant opportunity to develop an asset management 
approach for these types of facilities and related assets. 

Cause 

The backlog of needs to address flooding, water quality, operations, and 
planned projects is the District’s priority service-delivery focus. These more 
pressing needs have limited the District’s focus on developing asset 
management tools and life-cycle replacement costs. 

Effect 

Without considering life-cycle costs of projects and facilities, the true cost of 
Watershed Operation services may be underestimated, and long-term costs of 
service and associated funding needs deserve further review. 

Recommendation 

Watershed Operations should continue and expedite its efforts to accomplish 
an asset management program and to determine long-term scheduled 
replacement costs. This is discussed at the District-wide level in the main 
body of the final audit report. 
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Condition 


The District has a stated goal of zero drinking water regulatory violations, 
and has a track record of eight years (i.e., since 1998) without such a 
violation. The 1998 event was due to filter effluent valve control failure at 
one of the District’s three surface water treatment plants, and exceedance of 
the instantaneous turbidity standard to which the District is held, as 
evidenced by correspondence between the California Department of Health 
Services (DHS) and the District. 

The roles and responsibilities within the District regarding reporting and 
coordination with the District’s regulatory agency for drinking water, DHS, 
are generally clear and well-documented, and are primarily the responsibility 
of the Laboratory Services and Water Quality Units. This is based on verbal 
information from auditees as well as a review of the WUE’s policies and 
procedures and organizational descriptions in the FY 2006 WUE Business 
Plan. This is also substantiated by the WUE’s customer lists, which indicate 
the District’s annual meeting with DHS, quarterly meetings between Water 
Quality Unit staff and plant supervisors, stationing of Water Quality Unit 
process engineers at each of the three plants, as well as regular telephone and 
e-mail communication between the District and DHS. The District is in line 
with its high-performing agency peers with respect to its relationship with its 
drinking water regulatory agency. 

At the time of Red Oak’s fieldwork, the District did not have a stated goal 
regarding whether (or by how much) it strives to deliver water of higher 
quality than required by regulatory standards; however, it has several 
processes and results in place that indicate it does so. Specifically, the 
conversion to ozone is expected to yield taste-and-odor benefits, in addition 
to allowing the District to meet or exceed regulatory criteria as noted above. 
Also, the District’s finished water turbidity results are consistently lower 
than (i.e., better than) regulatory standards, as evidenced by its Partnership 
for Safe Water (PSW) reports. Following Red Oak’s WUE audit fieldwork, 
and during the development of this report, the District provided Red Oak 
with a draft version of its “CEO Work Plan,” which includes measurable 
objectives for the District exceeding regulatory standards, specifically, in the 
area of treated water disinfection byproducts. 

The District is to be commended for instigating its series of treatment 
process upgrades at its three surface water treatment plants over the last 
several years, most notably its conversion to ozone as its replacement for 
chlorine as its primary disinfectant. This and other process improvements 
(e.g., settled water chlorination) were proactive moves on the part of the 
District to ensure ongoing compliance with increasingly stringent state and 
federal regulations for microbial disinfection/inactivation and disinfection 
byproducts. 
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one - to control the costs associated with the District’s water treatment 
operations, but it is potentially problematic for a number of reasons: 

• It was the only cost-related metric at the Board/CEO level associated 
with the WUE’s operations, despite the fact that water treatment 
represents only approximately 10% (based on budgets provided in the 
FY 2006 WUE Annual Business Plan) of WUE’s budget and 
expenditures. 

@ It could be misused as a driver for increased “throughput” at the 
treatment plants to realize possible cost efficiencies associated with 
additional flow, perhaps at odds with a water resources management- 
based need to instead use local groundwater. 

® The basis for this value is not clear from information provided to Red 
Oak, and it does not account for the variety of raw water sources 
treated by the District or differences among the District’s three 
treatment plants. That is, a single cost goal for treated water does not 
reflect the different “cost scenarios” that result from the many source 
water/treatment plant combinations in use at the District over the long 
term. No provisions appear to be in place to adjust this value to 
reflect escalation in underlying costs (e.g., energy, chemicals), or to 
account for treatment process changes underway at the District’s 
plants (e.g., implementation of ozone disinfection). The associated 
risk is that plant staff would manage plant operations according to a 
potentially unrealistic cost metric, instead of to source water quality 
and finished water quality objectives. 

Red Oak understands from the validation process for this audit that the 
District is already be in the process of dispensing with this metric, although a 
revised version of it does appear in the District’s current “CEO Work Plan” 
draft. 

Cost-effectiveness 

There are numerous references to the WUE in the Board’s Governance 
Policies and elsewhere providing “cost-effective” services; however, aside 
from the water treatment cost metric noted above, the District does not 
formally define or track its overall WUE cost-effectiveness. In other words, 
there is one cost-related metric in place for the WUE’s treated water 
operations, but none for its imported water, raw water, groundwater 
management, or other activities. Red Oak recognizes that these activities are 
somewhat less amenable to cost quantification or tracking, and that industry 
knowledge or history of costs associated with these activities is generally less 
than more typical water treatment or utility operations costs. 
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As a result, the District has an opportunity to build upon its strength and 
history in WUE performance measurement (e.g., founding participation in 
AWWA’s QualServe, as noted in an earlier finding) to more fully represent 
and track WUE-wide costs in the context of its goals and objectives, hi other 
words, Red Oak recognizes that the District may need to go beyond the 
“state-of-the-practice” relative to its peer agencies to comprehensively 
measure and manage costs across its Water Utility Enterprise. 

Individual Cost-related Strengths 


A clear individual strength of the WUE in the area of cost management is its 
development of the “Operations Council on Excellence” (OCE), an in-house 
water utility operations optimization and cost-savings effort focused on 
identifying ways of reducing cost throughout the WUE’s water treatment and 
other processes. This effort has been successful to date, as evidenced by the 
program’s 2005 annual report, which documents approximately $800,000 per 
year in potential cost savings. Although this is a commendable effort, and 
can be applied as a model for other areas of the District to investigate their 
own cost-saving measures, the estimated cost savings represent only 
approximately one-half of one percent of the WUE’s annual budget. This is 
not to say that the OCE efforts are not worthwhile, but rather to highlight the 
potential for additional cost-saving opportunities elsewhere in the WUE. 
Other useful topics the OCE is addressing are opportunities for cross-training 
and work flexibility. 

As evidenced in WUE program plans and annual reports, the District also 
brings in significant external grant monies (e.g., in the area of water 
conservation) and has recently developed mechanisms to bank and sell 
excess imported water in wet years, all of which can offset costs. The District 
also shares costs with other agencies where appropriate (e.g., water recycling 
activities). However, there are no performance metrics in place driving these 
efforts. The District’s in-house look at its long-term water supply 
sustainability also highlighted cost-saving efforts undertaken by the Water 
Quality Unit in conjunction with treatment plant staff, for example, a 
chlorine contact tune calculation modification that could save the District up 
to $200,000 per year. 

Other cost-saving measures demonstrated by the District in the WUE area 
include: conducting a detailed operational efficiency report on the Pacheco 
Pump Station and energy efficiency studies for the Administration building 
and the Rinconada Water Treatment Plant, which included both typical 
building energy features (e.g., lighting) as well as industrial/process areas for 
potential efficiency improvements (e.g., energy/cost benefits of Variable 
Frequency Drives). The District also provided Red Oak with an example of a 
reconfiguration in the District’s local raw water conveyance system that will 
save the District $50,000 in water costs (assumed: annual), as well as about 
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Effect 

The District has generally strong planning and priority-setting mechanisms 
in place at the department level, as evidenced by the WUE Business Plan 
and quarterly tracking reports, for example. However, without a similar 
mechanism in place at the next highest level (District-wide), chiefs and 
managers understandably report difficulty in discerning (and developing, as 
necessary) agency-wide priorities. The District’s historical department- 
specific approach to business planning has also inhibited its ability to take 
full advantage of its position as a unified comprehensive water resources 
management agency. 

Recommendation 

The District should continue its efforts on its CEO Work Plan or similar 
agency-wide strategic business planning tool, and build upon its existing 
department-specific long-term and short-term planning strengths. During 
this process, the District also has the opportunity to revisit existing Board 
policies and CEO Interpretations, and ensure they are consistent with each 
other and enable the District to cariy out “comprehensive water resources 
management” as intended. This finding and recommendation is further 
developed and addressed at the District-wide level in the main body of the 
final audit report. 


WUE Opportunity for Improvement Finding No. 5 
Related Key Audit Objectives: “Asset Management ” 

“Reliability of Service ” 


Criterion 

The District should have a well-developed asset management program in 
place that addresses life-cycle management of its Water Utility Enterprise 
assets and enables the District to meet or exceed its level-of-service and 
reliability goals on a long-term basis. 

References 

j • Board Policy EL-7: 7.3; 7.8 

• Baldrige “Values”: “Focus on Results” and “Creating Value and 
Management by Fact” 

Condition 

The District is to be commended for having the key ingredients of an 
effective asset management plan in place within its WUE, as evidenced by 
verbal and documented information provided to Red Oak, specifically: 

® A well-developed utility asset inventory 

® Well-developed condition rating methodology and results 

• Integration (currently underway) of its local surface water system 
and treated water asset databases 
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Appendix One - Scope of Services 

Santa Clara Valley Water District Comprehensive Performance Audit 
I. Overview 

The purpose of this Agreement is to obtain a Comprehensive Performance Audit of the Santa 
Clara Valley Water District (District). The Comprehensive Performance Audit (Audit) will be 
an objective and independent evaluation of the Board’s compliance with their Governance 
Policies, and the CEO’s implementation of the Board’s Ends and Executive Limitation 
Policies. The audit will provide an assessment of the effectiveness and efficiency of the 
District’s operational and administrative systems, processes, and practices. 

This Agreement is pursuant to Board Governance Policies GP-4 and BL-5. According to GP- 
4, the Board will “continually improve Board performance through Board education and 
enriched input and deliberation.” In addition, the policies under BL-5 (BL-5,2) state that the 
Board will acquire monitoring data by one or more of three methods, one of which is by 
“external report, in which an external disinterested third party selected by the Board assesses 
compliance with Board policies.” 

This appendix includes and describes: 

• The performance expectations of the Consultant and confidentiality requirements of the 
District as they apply to the Consultant. 

• The standards and criteria to be applied by the Consultant in performing the audit. 

• The reporting of audit findings and disclosure of significant or material findings by the 
Consultant. 

• Standard definitions applicable to the audit. 

• District-provided services and responsibilities under this agreement. 

• The Scope of Work of the Consultant under this agreement. 

• The process by which the District Board of Directors (or its designee) and the Consultant 
will review progress of the audit periodically and agree on any changes to the scope of 
work deemed necessary as new information is gained through the audit. 

• The authority of the District to remove Consultant’s staff or subconsultants from the audit 
team and requirement for the Consultant to obtain prior District approval of any changes in 
the composition of the audit team. The “audit team” for the purposes of this statement 
includes key members of the Consultant’s team, such as the Project Officer, Project 
Manager, Deputy Project Manager, and individual audit leaders. In other words, the 
Consultant need not obtain approval from the District prior, to changing any junior or 
administrative support staff on the project team. 

II, District Expectations of Consultant and Confidentiality 

The District has the following performance expectations of the Consultant in carrying out the 
Comprehensive Performance Audit: 

A. The Consultant’s staff assigned to work at District facilities will wear District-issued 
identification at all times and will adhere to District security practices. The Consultant’s 
















Interviews: 2 individual interviews 
Deliverables: 1 preliminary draft and 1 final draft 
memorandum of findings, delivered electronically 
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3.4 Water Utility Enterprise 

Key Audit Objectives: 

Assess the effectiveness and efficiency of: 

Operational policies and procedures 

Compliance with State and Federal regulations 

Assessment of existing practices and comparison with best practices and 
relevant benchmarks: 

■ Cost 

• Overhead 

9 Asset management 

• Reliability of service 

9 Environmental management 

3.4.1 Develop plan and schedule for background research 

3.4.2 Conduct background research 

• Review documents including organizational structure and pertinent sections of 
in-house 5-yr close-out report from prior Water Utility Enterprise audit 

3.4.3 Develop audit approach 

• Identify potential audit criteria, likely to include the following: 

• Carver model 

9 Baldrige criteria 

9 District Board Ends Policies and Executive Limitations 
9 Internal goals for water utility asset management 
9 The “greener” aspect of conducting Water Utility Enterprise 
management/operations activities 
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• Execute other specific audit tasks and draft findings for each 
• Review findings in field with those directly involved, if possible, and 
document feedback 


Progress Milestone 3:6.4 $25,804 


3.6.5 Prepare memorandum of findings 

• Prepare draft for internal team review 

• Revise and review with appropriate client representatives (validation meeting) 

• Finalize memorandum of findings 


Task 3.6 Assumptions 
Meetings: 1 total (1 validation meeting) 
Interviews: 6 individual interviews 
Deliverables: lpreliminary draft and 1 final draft 
memorandum of findings, delivered electronically 


Progress Milestone 3.6.5 


$8,992 


4.0 Compilation of Findings and Development of 
Recommendations 

4.1 Summarize Individual Department Audit Findings 

4.1.1 Provide brief, summary documentation of existing performance assessment 
processes, systems, and procedures 

4.1.2 Prepare overall assessment of performance of organization against audit criteria, 
summarizing opportunities for improvement 


Progress Milestone 4.12 


4.1.3 Conduct meeting with the District Contract Manager and District 
Project Manager to review this summary of the individual department audits 

4.1.4 Incorporate any comments on this summary and produce a final summary of 
findings, to be used as the Findings section of the Summary Audit Report 
described in Task 4.2. 
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